Jul 06 20:37:54 devstack cinder-volume[75699]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 20:37:54 devstack cinder-volume[75699]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 20:37:54 devstack cinder-volume[75699]: we strongly recommend against using it for new projects.
Jul 06 20:37:54 devstack cinder-volume[75699]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 20:37:54 devstack cinder-volume[75699]: framework.  For more detail see
Jul 06 20:37:54 devstack cinder-volume[75699]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 20:37:54 devstack cinder-volume[75699]:   import eventlet  # noqa
Jul 06 20:37:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 20:37:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 20:37:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 20:37:57 devstack cinder-volume[75699]: INFO dbcounter [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Registered counter for database cinder
Jul 06 20:37:57 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:37:57 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writer thread running {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 20:37:57 devstack cinder-volume[75699]: INFO cinder.rpc [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 20:37:57 devstack cinder-volume[75699]: INFO cinder.rpc [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:37:58 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Determined volume DB was empty at startup.
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75699) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 20:37:58 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 06 20:37:58 devstack cinder-volume[75699]: WARNING stevedore.named [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 20:37:58 devstack cinder-volume[75699]: WARNING castellan.key_manager [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 20:37:58 devstack cinder-volume[75699]: WARNING cinder.keymgr.conf_key_mgr [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75699) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] CMD "cinder-rtstool verify" returned: 0 in 0.418s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:37:58 devstack cinder-volume[75699]: INFO cinder.rpc [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Jul 06 20:37:58 devstack cinder-volume[75699]: INFO cinder.rpc [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Jul 06 20:37:58 devstack cinder-volume[75699]: WARNING stevedore.named [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 20:37:58 devstack cinder-volume[75699]: WARNING castellan.key_manager [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 20:37:58 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:37:58 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Starting 1 workers
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Started child 75875 {{(pid=75699) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Full set of CONF: {{(pid=75699) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] ******************************************************************************** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Configuration options gathered from: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] ================================================================================ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] allow_availability_zone_fallback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] allow_compression_on_image_upload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] allowed_direct_url_schemes     = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] api_rate_limit                 = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] auth_strategy                  = keystone {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] az_cache_duration              = 3600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_availability_zone      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_host                   = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_name                   = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_stats_polling_interval = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backup_api_class               = cinder.backup.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backup_name_template           = backup-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backup_use_same_host           = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backup_use_temp_snapshot       = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] chap_password                  = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] chap_username                  =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_internal_tenant_project_id = 22426243f834473da7ef617fad5606d6 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_internal_tenant_user_id = 0c301431c2624d9898e5321e458e06d6 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cloned_volume_same_az          = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75875]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cluster                        = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] compression_format             = gzip {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] compute_api_class              = cinder.compute.nova.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] config_dir                     = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] config_source                  = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] control_exchange               = openstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] debug                          = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] default_availability_zone      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] default_group_type             = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] default_volume_type            = lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] disk_geometry                  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] driver_client_cert             = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] driver_client_cert_key         = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] driver_data_namespace          = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] driver_ssl_cert_path           = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] driver_ssl_cert_verify         = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] driver_use_ssl                 = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] enable_force_upload            = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] enable_new_services            = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] enable_unsupported_driver      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] enforce_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] filter_function                = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_api_insecure            = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_api_servers             = ['http://192.168.122.231/image'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_api_ssl_compression     = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_ca_certificates_file    = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_catalog_info            = image:glance:publicURL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_certfile                = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_keyfile                 = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_num_retries             = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance_request_timeout         = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] goodness_function              = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] graceful_shutdown_timeout      = 5 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] group_api_class                = cinder.group.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] host                           = devstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_compress_on_upload       = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_conversion_address_space_limit = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_conversion_cpu_limit     = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_conversion_disable       = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_upload_use_cinder_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_upload_use_internal_tenant = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_volume_cache_enabled     = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_volume_cache_max_count   = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] image_volume_cache_max_size_gb = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] init_host_max_objects_retrieval = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] iscsi_target_flags             =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] iscsi_write_cache              = on {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] iser_helper                    = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] iser_ip_address                = 192.168.122.231 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] iser_port                      = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_color                      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_config_append              = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_dir                        = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_file                       = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_options                    = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_rotate_interval            = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_rotate_interval_type       = days {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] log_rotation_type              = none {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] max_age                        = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] max_logfile_count              = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] max_logfile_size_mb            = 200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] max_over_subscription_ratio    = 20.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] message_reap_interval          = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] message_ttl                    = 2592000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] migration_create_volume_timeout_secs = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] monkey_patch                   = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] monkey_patch_modules           = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] my_ip                          = 192.168.122.231 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] no_snapshot_gb_quota           = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] num_iser_scan_tries            = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] num_shell_tries                = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] num_volume_device_scan_tries   = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] nvmeof_conn_info_version       = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] nvmet_ns_id                    = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] nvmet_port_id                  = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] osapi_max_limit                = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] osapi_volume_ext_list          = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] osapi_volume_listen_port       = 8776 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] osapi_volume_use_ssl           = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] osapi_volume_workers           = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] per_volume_size_limit          = -1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] periodic_fuzzy_delay           = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] periodic_interval              = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] public_endpoint                = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] publish_errors                 = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] quota_backup_gigabytes         = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] quota_backups                  = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] quota_gigabytes                = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] quota_groups                   = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] quota_snapshots                = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] quota_volumes                  = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] rate_limit_burst               = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] rate_limit_except_level        = CRITICAL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] rate_limit_interval            = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] reinit_driver_count            = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] replication_device             = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] report_discard_supported       = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] report_interval                = 120 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] reservation_clean_interval     = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] reservation_expire             = 86400 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] reserved_image_namespaces      = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] reserved_percentage            = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] rpc_response_timeout           = 120 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] run_external_periodic_tasks    = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] scst_target_driver             = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] scst_target_iqn_name           = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_down_time              = 720 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] shell_completion               = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] snapshot_name_template         = snapshot-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] snapshot_same_host             = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] split_loggers                  = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] state_path                     = /opt/stack/data/cinder {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] storage_availability_zone      = nova {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] storage_protocol               = iSCSI {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] syslog_log_facility            = LOG_USER {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] target_helper                  = lioadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] target_ip_address              = 192.168.122.231 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] target_port                    = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] target_protocol                = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] target_secondary_ip_addresses  = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] trace_flags                    = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] transport_url                  = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] until_refresh                  = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:58 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] use_chap_auth                  = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] use_default_quota_class        = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] use_journal                    = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] use_json                       = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] use_multipath_for_image_xfer   = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] use_stderr                     = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] use_syslog                     = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] verify_glance_signatures       = enabled {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_api_class               = cinder.volume.api.API {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_backend_name            = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_clear                   = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_clear_ionice            = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_clear_size              = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_copy_bps_limit          = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_dd_blocksize            = 1M {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_name_template           = volume-%s {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_service_inithost_offload = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volume_usage_audit_period      = month {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] zoning_mode                    = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_concurrency.disable_process_locking = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack sudo[75883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.auth_type   = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.auth_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.cache       = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack sudo[75883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.certfile    = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.include_service_catalog = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.insecure    = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.interface   = public {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.keyfile     = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_password =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcache_username =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75875]: INFO cinder.volume.manager [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.region_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.service_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.231/identity {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.backend                  = dogpile.cache.null {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.backend_argument         = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.backend_expiration_time  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.config_prefix            = cache.oslo {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.debug_cache_backend      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.enable_retry_client      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.enable_socket_keepalive  = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.enabled                  = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.expiration_time          = 600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.hashclient_retry_attempts = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.memcache_dead_retry      = 300 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.memcache_sasl_enabled    = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.password                 = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.proxies                  = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.redis_db                 = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.redis_server             = localhost:6379 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.retry_attempts           = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.retry_delay              = 0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.socket_keepalive_count   = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.socket_keepalive_idle    = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.socket_keepalive_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.socket_timeout           = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.tls_allowed_ciphers      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.tls_cafile               = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.tls_certfile             = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.tls_enabled              = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.tls_keyfile              = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cache.username                 = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] coordination.backend_url       = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.asyncio_connection    = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.asyncio_slave_connection = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.backend               = sqlalchemy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.connection            = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.connection_debug      = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.connection_parameters =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.connection_recycle_time = 3600 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.connection_trace      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.db_inc_retry_interval = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.db_max_retries        = 20 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.db_max_retry_interval = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.db_retry_interval     = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.max_overflow          = 50 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.max_pool_size         = 5 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.max_retries           = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.mysql_wsrep_sync_wait = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.pool_timeout          = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.retry_interval        = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.slave_connection      = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.sqlite_synchronous    = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.synchronous_reader    = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] database.use_db_reconnect      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.connection_string     = messaging:// {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.enabled               = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.es_doc_type           = notification {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.es_scroll_size        = 10000 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.es_scroll_time        = 2m {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.filter_error_trace    = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.hmac_keys             = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.sentinel_service_name = mymaster {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.socket_timeout        = 0.1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.trace_requests        = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler.trace_sqlalchemy      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler_jaeger.process_tags   = {} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler_jaeger.service_name_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] profiler_otlp.service_name_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.enforce_new_defaults = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.enforce_scope      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.policy_default_rule = default {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.056s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] privsep_osbrick.group          = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] privsep_osbrick.helper_command = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] privsep_osbrick.user           = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_sys_admin.group         = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_sys_admin.helper_command = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] cinder_sys_admin.user          = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.auth_section      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.auth_type         = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.cafile            = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.certfile          = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.collect_timing    = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.insecure          = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.keyfile           = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.send_service_user_token = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.split_loggers     = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] service_user.timeout           = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.auth_section            = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.auth_type               = password {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.certfile                = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.collect_timing          = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.insecure                = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.keyfile                 = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.region_name             = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.split_loggers           = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] glance.timeout                 = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.chap_password = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.chap_username =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.disk_geometry = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.driver_use_ssl = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.extra_capabilities = {} {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.filter_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.goodness_function = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.iscsi_target_flags =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.iscsi_write_cache = on {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.iser_helper   = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.iser_ip_address = 192.168.122.231 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.iser_port     = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.lvm_share_target = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.lvm_type      = auto {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.num_shell_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.report_discard_supported = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.reserved_percentage = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.target_helper = tgtadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.target_ip_address = 192.168.122.231 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.target_port   = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.target_protocol = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.trace_flags   = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.unique_fqdn_network = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.use_chap_auth = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_backend_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_clear  = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_clear_size = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_reports.file_event_handler = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_reports.log_dir           = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.backend_host       = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.chap_password      = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.chap_username      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.disk_geometry      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.driver_client_cert = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.extra_capabilities = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.filter_function    = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.goodness_function  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.iser_helper        = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.iser_ip_address    = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.iser_port          = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.lvm_share_target   = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.lvm_type           = auto {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.num_shell_tries    = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.replication_device = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.report_discard_supported = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.reserved_percentage = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.scst_target_driver = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.storage_protocol   = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.target_helper      = lioadm {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.target_ip_address  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.target_port        = 3260 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.trace_flags        = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.use_chap_auth      = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_clear       = zero {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_clear_size  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] lvmdriver-1.volumes_dir        = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_notifications.driver = [] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_notifications.retry = -1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] key_manager.fixed_key          = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.barbican_api_version  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack sudo[75883]: pam_unix(sudo:session): session closed for user root
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.barbican_endpoint     = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.barbican_endpoint_type = public {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.barbican_region_name  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.cafile                = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.certfile              = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.collect_timing        = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.insecure              = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.keyfile               = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.number_of_retries     = 60 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.retry_delay           = 1 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.send_service_user_token = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.split_loggers         = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.timeout               = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.verify_ssl            = True {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican.verify_ssl_path       = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.auth_section = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.auth_type = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.cafile   = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.certfile = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.collect_timing = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.insecure = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack sudo[75889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.keyfile  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.split_loggers = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] barbican_service_user.timeout  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.approle_role_id          = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.approle_secret_id        = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.kv_mountpoint            = secret {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.kv_path                  = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack sudo[75889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.kv_version               = 2 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.namespace                = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.root_token_id            = **** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.ssl_ca_crt_file          = None {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.timeout                  = 60.0 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.use_ssl                  = False {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:37:59 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] ******************************************************************************** {{(pid=75699) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.851s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:37:59 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:00 devstack sudo[75889]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:00 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.650s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:00 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:38:00 devstack cinder-volume[75875]: INFO cinder.brick.local_dev.lvm [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Jul 06 20:38:00 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:00 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:00 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:00 devstack sudo[76138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:38:00 devstack sudo[76138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:01 devstack sudo[76138]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:01 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:01 devstack cinder-volume[75875]: DEBUG cinder.brick.local_dev.lvm [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75875) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Jul 06 20:38:01 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:01 devstack sudo[76360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:01 devstack sudo[76360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:02 devstack sudo[76360]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:02 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.604s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:02 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:02 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:02 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:02 devstack sudo[76659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:02 devstack sudo[76659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:03 devstack sudo[76659]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:03 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.696s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:03 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:03 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:03 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:03 devstack sudo[76665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Jul 06 20:38:03 devstack sudo[76665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:04 devstack sudo[76665]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:04 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.652s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:04 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:04 devstack sudo[76669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:38:04 devstack sudo[76669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:04 devstack sudo[76669]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:04 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.685s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:04 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:04 devstack sudo[76673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:38:04 devstack sudo[76673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:05 devstack sudo[76673]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:05 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.824s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:05 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:05 devstack sudo[76678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:38:05 devstack sudo[76678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:06 devstack sudo[76678]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:06 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:06 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:06 devstack sudo[76690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:06 devstack sudo[76690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:07 devstack sudo[76690]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:07 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.846s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:07 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:07 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:07 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:07 devstack sudo[76697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:07 devstack sudo[76697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:07 devstack sudo[76697]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:07 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:07 devstack cinder-volume[75875]: INFO cinder.volume.drivers.lvm [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Jul 06 20:38:07 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:07 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:08 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:08 devstack sudo[76709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:08 devstack sudo[76709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:08 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:38:08 devstack sudo[76709]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:08 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.843s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:08 devstack cinder-volume[75875]: DEBUG cinder.volume.drivers.lvm [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Updating volume stats {{(pid=75875) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 20:38:08 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:08 devstack sudo[76826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:38:08 devstack sudo[76826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:09 devstack sudo[76826]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:09 devstack sudo[76966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:38:09 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:10 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:10 devstack sudo[76972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:10 devstack sudo[76972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:10 devstack sudo[76972]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:10 devstack sudo[76975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:38:10 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:11 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.654s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:11 devstack cinder-volume[75875]: INFO cinder.volume.driver [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG cinder.volume.driver [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75875) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG oslo_db.sqlalchemy.engines [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75875) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG dbcounter [-] [75875] Writer thread running {{(pid=75875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG cinder.db.api [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Building query based on filter {{(pid=75875) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG cinder.image.image_utils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75875) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 20:38:11 devstack cinder-volume[75875]: INFO cinder.keymgr.migration [None req-90da5cbf-9589-4c94-aafb-e26db5be082d None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG cinder.volume.drivers.lvm [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Updating volume stats {{(pid=75875) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 20:38:11 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:11 devstack sudo[76979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:38:11 devstack sudo[76979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:12 devstack sudo[76979]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:12 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:12 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:12 devstack sudo[76982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:38:12 devstack sudo[76982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:12 devstack sudo[76982]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:12 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:12 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:12 devstack sudo[76987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:12 devstack sudo[76987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:13 devstack sudo[76987]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:13 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:13 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:13 devstack sudo[76993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:38:13 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:14 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG cinder.manager [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Notifying Schedulers of capabilities ... {{(pid=75875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:38:14 devstack cinder-volume[75875]: INFO cinder.volume.manager [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Driver initialization completed successfully.
Jul 06 20:38:14 devstack cinder-volume[75875]: INFO cinder.manager [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Initiating service 2 cleanup
Jul 06 20:38:14 devstack cinder-volume[75875]: INFO cinder.manager [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Service 2 cleanup completed.
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG cinder.service [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Creating RPC server for service cinder-volume {{(pid=75875) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG cinder.service [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75875) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 20:38:14 devstack cinder-volume[75875]: INFO cinder.volume.manager [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG cinder.volume.drivers.lvm [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Updating volume stats {{(pid=75875) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:14 devstack sudo[76997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:38:14 devstack sudo[76997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:14 devstack sudo[76997]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.653s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:14 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:14 devstack sudo[77001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:38:14 devstack sudo[77001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:15 devstack sudo[77001]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:15 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:15 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:15 devstack sudo[77004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:38:15 devstack sudo[77004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:16 devstack sudo[77004]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:16 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:16 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:38:16 devstack sudo[77061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:38:16 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:38:16 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root
Jul 06 20:38:16 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:38:16 devstack cinder-volume[75875]: INFO cinder.volume.manager [None req-72f3be65-d8c6-4830-b023-7ad06d4156b8 None None] Driver post RPC initialization completed successfully.
Jul 06 20:38:26 devstack cinder-volume[75875]: DEBUG dbcounter [-] [75875] Writing DB stats cinder:SELECT=4 {{(pid=75875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:38:26 devstack cinder-volume[75875]: DEBUG dbcounter [-] [75875] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:39:08 devstack cinder-volume[75875]: DEBUG oslo_service.periodic_task [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:39:08 devstack cinder-volume[75875]: DEBUG cinder.volume.drivers.lvm [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Updating volume stats {{(pid=75875) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 20:39:08 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:39:08 devstack sudo[78720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:39:08 devstack sudo[78720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:39:09 devstack sudo[78720]: pam_unix(sudo:session): session closed for user root
Jul 06 20:39:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:39:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:39:09 devstack sudo[78723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:39:09 devstack sudo[78723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:39:10 devstack sudo[78723]: pam_unix(sudo:session): session closed for user root
Jul 06 20:39:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:39:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:39:10 devstack sudo[78726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:39:10 devstack sudo[78726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:39:10 devstack sudo[78726]: pam_unix(sudo:session): session closed for user root
Jul 06 20:39:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.653s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:39:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:39:10 devstack sudo[78729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:39:10 devstack sudo[78729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:39:11 devstack sudo[78729]: pam_unix(sudo:session): session closed for user root
Jul 06 20:39:11 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:39:11 devstack cinder-volume[75875]: DEBUG cinder.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Notifying Schedulers of capabilities ... {{(pid=75875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:39:11 devstack cinder-volume[75875]: DEBUG oslo_service.periodic_task [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running periodic task VolumeManager._thread_info {{(pid=75875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:39:11 devstack cinder-volume[75875]: DEBUG cinder.volume.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] thread count: 6 {{(pid=75875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:39:11 devstack cinder-volume[75875]: DEBUG cinder.volume.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] thread info: [<_MainThread(MainThread, started 135403135021184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135403022081920)>, <Thread(Thread-3 (stat_writer), started daemon 135403027056640)>, <Thread(Rabbit-heartbeat, started daemon 135403022912704)>, <Thread(Thread-5 (_runner), started daemon 135403023060288)>, <Thread(Thread-7 (_runner), started daemon 135403021065728)>] {{(pid=75875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:40:08 devstack cinder-volume[75875]: DEBUG oslo_service.periodic_task [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:40:08 devstack cinder-volume[75875]: DEBUG cinder.volume.drivers.lvm [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Updating volume stats {{(pid=75875) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 20:40:08 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:40:08 devstack sudo[82008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:40:08 devstack sudo[82008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:40:09 devstack sudo[82008]: pam_unix(sudo:session): session closed for user root
Jul 06 20:40:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:40:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:40:09 devstack sudo[82027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:40:09 devstack sudo[82027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:40:10 devstack sudo[82027]: pam_unix(sudo:session): session closed for user root
Jul 06 20:40:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.601s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:40:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:40:10 devstack sudo[82031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:40:10 devstack sudo[82031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:40:10 devstack sudo[82031]: pam_unix(sudo:session): session closed for user root
Jul 06 20:40:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.612s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:40:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:40:10 devstack sudo[82036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:40:10 devstack sudo[82036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:40:11 devstack sudo[82036]: pam_unix(sudo:session): session closed for user root
Jul 06 20:40:11 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:40:11 devstack cinder-volume[75875]: DEBUG cinder.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Notifying Schedulers of capabilities ... {{(pid=75875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:40:26 devstack cinder-volume[75875]: DEBUG dbcounter [-] [75875] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:41:08 devstack cinder-volume[75875]: DEBUG oslo_service.periodic_task [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:41:08 devstack cinder-volume[75875]: DEBUG cinder.volume.drivers.lvm [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Updating volume stats {{(pid=75875) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 20:41:08 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:41:08 devstack sudo[83883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:41:08 devstack sudo[83883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:41:09 devstack sudo[83883]: pam_unix(sudo:session): session closed for user root
Jul 06 20:41:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:41:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:41:09 devstack sudo[83908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:41:09 devstack sudo[83908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:41:10 devstack sudo[83908]: pam_unix(sudo:session): session closed for user root
Jul 06 20:41:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:41:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:41:10 devstack sudo[83927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:41:10 devstack sudo[83927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:41:10 devstack sudo[83927]: pam_unix(sudo:session): session closed for user root
Jul 06 20:41:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:41:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:41:10 devstack sudo[83949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:41:10 devstack sudo[83949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:41:11 devstack sudo[83949]: pam_unix(sudo:session): session closed for user root
Jul 06 20:41:11 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:41:11 devstack cinder-volume[75875]: DEBUG cinder.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Notifying Schedulers of capabilities ... {{(pid=75875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:41:11 devstack cinder-volume[75875]: DEBUG oslo_service.periodic_task [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running periodic task VolumeManager._thread_info {{(pid=75875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:41:11 devstack cinder-volume[75875]: DEBUG cinder.volume.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] thread count: 6 {{(pid=75875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:41:11 devstack cinder-volume[75875]: DEBUG cinder.volume.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] thread info: [<_MainThread(MainThread, started 135403135021184)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 135403022081920)>, <Thread(Thread-3 (stat_writer), started daemon 135403027056640)>, <Thread(Rabbit-heartbeat, started daemon 135403022912704)>, <Thread(Thread-5 (_runner), started daemon 135403023060288)>, <Thread(Thread-7 (_runner), started daemon 135403021065728)>] {{(pid=75875) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:42:08 devstack cinder-volume[75875]: DEBUG oslo_service.periodic_task [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75875) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:42:08 devstack cinder-volume[75875]: DEBUG cinder.volume.drivers.lvm [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Updating volume stats {{(pid=75875) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Jul 06 20:42:08 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:08 devstack sudo[85193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Jul 06 20:42:08 devstack sudo[85193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:09 devstack sudo[85193]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.641s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:09 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:09 devstack sudo[85201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:42:09 devstack sudo[85201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:10 devstack sudo[85201]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:10 devstack sudo[85253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Jul 06 20:42:10 devstack sudo[85253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:10 devstack sudo[85253]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.690s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:10 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:10 devstack sudo[85319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Jul 06 20:42:10 devstack sudo[85319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:11 devstack sudo[85319]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:11 devstack cinder-volume[75875]: DEBUG oslo_concurrency.processutils [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.693s {{(pid=75875) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:11 devstack cinder-volume[75875]: DEBUG cinder.manager [None req-619b0c19-79d2-46ce-ad18-289c7590d596 None None] Notifying Schedulers of capabilities ... {{(pid=75875) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:42:26 devstack cinder-volume[75875]: DEBUG dbcounter [-] [75875] Writing DB stats cinder:SELECT=1 {{(pid=75875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:42:26 devstack cinder-volume[75875]: DEBUG dbcounter [-] [75875] Writing DB stats cinder:UPDATE=1 {{(pid=75875) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:42:39 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Caught SIGTERM, stopping children
Jul 06 20:42:39 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Acquiring lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 20:42:39 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Acquired lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 20:42:39 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Releasing lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 20:42:39 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Stop services. {{(pid=75699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 06 20:42:39 devstack cinder-volume[75699]: DEBUG oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Killing children. {{(pid=75699) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 06 20:42:39 devstack cinder-volume[75699]: INFO oslo_service.backend._eventlet.service [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Waiting on 1 children to exit
Jul 06 20:42:44 devstack cinder-volume[75875]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting
Jul 06 20:42:44 devstack cinder-volume[85982]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 20:42:44 devstack cinder-volume[85982]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 20:42:44 devstack cinder-volume[85982]: we strongly recommend against using it for new projects.
Jul 06 20:42:44 devstack cinder-volume[85982]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 20:42:44 devstack cinder-volume[85982]: framework.  For more detail see
Jul 06 20:42:44 devstack cinder-volume[85982]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 20:42:44 devstack cinder-volume[85982]:   import eventlet  # noqa
Jul 06 20:42:46 devstack cinder-volume[85982]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85982) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 20:42:46 devstack cinder-volume[85982]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85982) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 20:42:46 devstack cinder-volume[85982]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85982) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 20:42:47 devstack cinder-volume[85982]: INFO dbcounter [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Registered counter for database cinder
Jul 06 20:42:47 devstack cinder-volume[85982]: DEBUG oslo_db.sqlalchemy.engines [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85982) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG dbcounter [-] [85982] Writer thread running {{(pid=85982) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 20:42:48 devstack cinder-volume[85982]: INFO cinder.rpc [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 20:42:48 devstack cinder-volume[85982]: INFO cinder.rpc [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_db.sqlalchemy.engines [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85982) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:48 devstack cinder-volume[85982]: INFO cinder.volume.manager [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Determined volume DB was empty at startup.
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG cinder.volume.manager [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85982) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 20:42:48 devstack cinder-volume[85982]: INFO cinder.volume.manager [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Service not found for updating active_backend_id, assuming default for driver init.
Jul 06 20:42:48 devstack cinder-volume[85982]: WARNING stevedore.named [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 20:42:48 devstack cinder-volume[85982]: WARNING castellan.key_manager [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 20:42:48 devstack cinder-volume[85982]: WARNING cinder.keymgr.conf_key_mgr [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 20:42:48 devstack cinder-volume[85982]: INFO cinder.volume.manager [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_db.sqlalchemy.engines [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85982) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:48 devstack cinder-volume[85982]: INFO oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Starting 1 workers
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Started child 86254 {{(pid=85982) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Full set of CONF: {{(pid=85982) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] ******************************************************************************** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Configuration options gathered from: {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] ================================================================================ {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] allow_availability_zone_fallback = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] allow_compression_on_image_upload = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] allowed_direct_url_schemes     = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] api_rate_limit                 = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[86254]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] auth_strategy                  = keystone {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_availability_zone      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_host                   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_name                   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_stats_polling_interval = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backup_api_class               = cinder.backup.api.API {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backup_name_template           = backup-%s {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backup_use_same_host           = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backup_use_temp_snapshot       = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] chap_password                  = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] chap_username                  =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_internal_tenant_project_id = 22426243f834473da7ef617fad5606d6 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_internal_tenant_user_id = 0c301431c2624d9898e5321e458e06d6 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cluster                        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] compression_format             = gzip {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] compute_api_class              = cinder.compute.nova.API {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] config_dir                     = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] config_source                  = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] control_exchange               = openstack {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] debug                          = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] default_availability_zone      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] default_group_type             = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] default_volume_type            = QuobyteHD {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] disk_geometry                  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] driver_client_cert             = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] driver_client_cert_key         = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] driver_data_namespace          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] driver_ssl_cert_path           = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] driver_ssl_cert_verify         = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] driver_use_ssl                 = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] enable_new_services            = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] enable_unsupported_driver      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] enabled_backends               = ['QuobyteHD'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] enforce_multipath_for_image_xfer = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] filter_function                = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_api_insecure            = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_api_servers             = ['http://192.168.122.231/image'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_api_ssl_compression     = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_ca_certificates_file    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_catalog_info            = image:glance:publicURL {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_certfile                = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_keyfile                 = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_num_retries             = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance_request_timeout         = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] goodness_function              = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] graceful_shutdown_timeout      = 5 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] group_api_class                = cinder.group.api.API {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] host                           = devstack {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_compress_on_upload       = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_conversion_address_space_limit = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_conversion_cpu_limit     = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_conversion_disable       = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_upload_use_cinder_backend = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_upload_use_internal_tenant = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_volume_cache_enabled     = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_volume_cache_max_count   = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] image_volume_cache_max_size_gb = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] init_host_max_objects_retrieval = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] instance_format                = [instance: %(uuid)s]  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] iscsi_target_flags             =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] iscsi_write_cache              = on {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] iser_helper                    = tgtadm {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] iser_ip_address                = 192.168.122.231 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] iser_port                      = 3260 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_color                      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_config_append              = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_dir                        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_file                       = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_options                    = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_rotate_interval            = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_rotate_interval_type       = days {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] log_rotation_type              = none {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] max_age                        = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] max_logfile_count              = 30 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] max_logfile_size_mb            = 200 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] max_over_subscription_ratio    = 20.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] message_reap_interval          = 86400 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] message_ttl                    = 2592000 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] migration_create_volume_timeout_secs = 300 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] monkey_patch                   = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] monkey_patch_modules           = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] my_ip                          = 192.168.122.231 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] no_snapshot_gb_quota           = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] num_iser_scan_tries            = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] num_shell_tries                = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] num_volume_device_scan_tries   = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[86254]: INFO cinder.volume.manager [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.remotefs [None req-850b9398-e715-4480-86fe-4c88551e453d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86254) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] nvmeof_conn_info_version       = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] nvmet_ns_id                    = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] nvmet_port_id                  = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] osapi_max_limit                = 1000 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] osapi_volume_ext_list          = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] osapi_volume_listen            = 0.0.0.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] osapi_volume_listen_port       = 8776 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] osapi_volume_use_ssl           = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] osapi_volume_workers           = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] per_volume_size_limit          = -1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] periodic_fuzzy_delay           = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] periodic_interval              = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] project_id_regex               = [0-9a-f\-]+ {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] public_endpoint                = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] publish_errors                 = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] quota_backup_gigabytes         = 1000 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] quota_backups                  = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] quota_gigabytes                = 1000 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] quota_groups                   = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] quota_snapshots                = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] quota_volumes                  = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] rate_limit_burst               = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] rate_limit_except_level        = CRITICAL {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] rate_limit_interval            = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] reinit_driver_count            = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] replication_device             = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] report_discard_supported       = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] report_interval                = 120 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] reservation_clean_interval     = 86400 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] reservation_expire             = 86400 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] reserved_image_namespaces      = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] reserved_percentage            = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] rpc_response_timeout           = 120 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] run_external_periodic_tasks    = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] scst_target_driver             = iscsi {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] scst_target_iqn_name           = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_down_time              = 720 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] shell_completion               = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] snapshot_name_template         = snapshot-%s {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] split_loggers                  = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] state_path                     = /opt/stack/data/cinder {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] storage_availability_zone      = nova {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] storage_protocol               = iSCSI {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] syslog_log_facility            = LOG_USER {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] target_helper                  = lioadm {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] target_ip_address              = 192.168.122.231 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] target_port                    = 3260 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] target_protocol                = iscsi {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] target_secondary_ip_addresses  = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] trace_flags                    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] transfer_api_class             = cinder.transfer.api.API {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] transport_url                  = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] until_refresh                  = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] use_chap_auth                  = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] use_default_quota_class        = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] use_journal                    = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] use_json                       = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] use_multipath_for_image_xfer   = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] use_stderr                     = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] use_syslog                     = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] verify_glance_signatures       = enabled {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_api_class               = cinder.volume.api.API {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_backend_name            = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_clear                   = zero {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_clear_ionice            = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_clear_size              = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_copy_bps_limit          = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_dd_blocksize            = 1M {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_name_template           = volume-%s {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_service_inithost_offload = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volume_usage_audit_period      = month {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] zoning_mode                    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_concurrency.disable_process_locking = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.auth_section = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.auth_type   = password {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.auth_version = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.cache       = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.certfile    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.delay_auth_decision = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.http_connect_timeout = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.include_service_catalog = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.insecure    = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.interface   = public {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86254) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 06 20:42:48 devstack cinder-volume[86254]: WARNING cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 06 20:42:48 devstack cinder-volume[86254]: WARNING cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.keyfile     = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_password =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Running cmd (subprocess): mount.quobyte {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcache_username =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.region_name = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.service_token_roles_required = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.service_type = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.token_cache_time = 300 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.231/identity {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.backend                  = dogpile.cache.null {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.backend_argument         = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.backend_expiration_time  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.config_prefix            = cache.oslo {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.debug_cache_backend      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.enable_retry_client      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.enable_socket_keepalive  = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.enabled                  = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.expiration_time          = 600 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.hashclient_retry_attempts = 2 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.memcache_dead_retry      = 300 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.memcache_pool_maxsize    = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.memcache_sasl_enabled    = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.password                 = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.proxies                  = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.redis_db                 = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.redis_sentinel_service_name = mymaster {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.redis_server             = localhost:6379 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.retry_attempts           = 2 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.retry_delay              = 0.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.socket_keepalive_count   = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.socket_keepalive_idle    = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.socket_keepalive_interval = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.socket_timeout           = 1.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.tls_allowed_ciphers      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.tls_cafile               = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.tls_certfile             = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.tls_enabled              = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.tls_keyfile              = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cache.username                 = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] coordination.backend_url       = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.asyncio_connection    = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.asyncio_slave_connection = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.backend               = sqlalchemy {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.connection            = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.connection_debug      = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.connection_parameters =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.connection_recycle_time = 3600 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.connection_trace      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.db_inc_retry_interval = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.db_max_retries        = 20 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.db_max_retry_interval = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.db_retry_interval     = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.max_overflow          = 50 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.max_pool_size         = 5 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.max_retries           = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.mysql_wsrep_sync_wait = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.pool_timeout          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.retry_interval        = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.slave_connection      = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.sqlite_synchronous    = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.synchronous_reader    = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] database.use_db_reconnect      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.connection_string     = messaging:// {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.enabled               = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.es_doc_type           = notification {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.es_scroll_size        = 10000 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.es_scroll_time        = 2m {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.filter_error_trace    = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.hmac_keys             = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.sentinel_service_name = mymaster {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.socket_timeout        = 0.1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.trace_requests        = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack quobyte-client[86263]: Reading configuration file: /etc/quobyte/client.cfg
Jul 06 20:42:48 devstack quobyte-client[86263]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler.trace_sqlalchemy      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler_jaeger.process_tags   = {} {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler_jaeger.service_name_prefix = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] profiler_otlp.service_name_prefix = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.enforce_new_defaults = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.enforce_scope      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.policy_default_rule = default {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.policy_file        = policy.yaml {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86254) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:42:48 devstack cinder-volume[86254]: INFO cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 ...
Jul 06 20:42:48 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 -c /etc/quobyte/client-cinder.cfg {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_policy.remote_timeout     = 60.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] privsep_osbrick.group          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] privsep_osbrick.helper_command = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] privsep_osbrick.user           = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_sys_admin.group         = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_sys_admin.helper_command = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] cinder_sys_admin.user          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.auth_section      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.auth_type         = password {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.cafile            = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.certfile          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.collect_timing    = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.insecure          = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.keyfile           = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.send_service_user_token = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.split_loggers     = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] service_user.timeout           = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.auth_section            = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.auth_type               = password {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.certfile                = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.collect_timing          = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.insecure                = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.keyfile                 = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack sudo[86264]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 -c /etc/quobyte/client-cinder.cfg
Jul 06 20:42:48 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.region_name             = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.split_loggers           = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] glance.timeout                 = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.backend_availability_zone = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.chap_password = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.chap_username =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.disk_geometry = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.driver_client_cert = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.driver_client_cert_key = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.driver_data_namespace = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.driver_use_ssl = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.enable_unsupported_driver = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.extra_capabilities = {} {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.filter_function = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.goodness_function = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.iscsi_target_flags =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.iscsi_write_cache = on {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.iser_helper   = tgtadm {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.iser_ip_address = 192.168.122.231 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.iser_port     = 3260 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_host      =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_login     = admin {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_mount_options = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_password  = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_private_key =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_share_path =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_ssh_port  = 22 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.num_shell_tries = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.nvmet_port_id = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.quobyte_client_cfg = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.quobyte_volume_url = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.replication_device = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.report_discard_supported = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.reserved_percentage = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.scst_target_driver = iscsi {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.scst_target_iqn_name = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.storage_protocol = iSCSI {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.target_helper = tgtadm {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.target_ip_address = 192.168.122.231 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.target_port   = 3260 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.target_protocol = iscsi {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.trace_flags   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.unique_fqdn_network = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.use_chap_auth = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_backend_name = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_clear  = zero {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_clear_ionice = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_clear_size = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_reports.file_event_handler = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_reports.log_dir           = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.backend_availability_zone = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.backend_host         = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.chap_password        = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.chap_username        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.chiscsi_conf         = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.disk_geometry        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.driver_client_cert   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.driver_client_cert_key = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.driver_data_namespace = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.driver_use_ssl       = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.extra_capabilities   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.filter_function      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.goodness_function    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.iscsi_target_flags   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.iscsi_write_cache    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.iser_helper          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.iser_ip_address      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.iser_port            = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.iser_target_prefix   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_host             = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_login            = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_mount_options    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_password         = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_private_key      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_share_path       = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_ssh_port         = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.num_shell_tries      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nvmet_ns_id          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.nvmet_port_id        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.replication_device   = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.report_discard_supported = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.reserved_percentage  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.scst_target_driver   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.storage_protocol     = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.target_helper        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.target_ip_address    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.target_port          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.target_prefix        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.target_protocol      = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.trace_flags          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.unique_fqdn_network  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.use_chap_auth        = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_clear         = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_clear_ionice  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_clear_size    = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] QuobyteHD.volumes_dir          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.ssl      = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.ssl_version =  {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_notifications.driver = [] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_notifications.retry = -1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] oslo_messaging_notifications.transport_url = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] key_manager.fixed_key          = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.barbican_api_version  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.barbican_endpoint     = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.barbican_endpoint_type = public {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.barbican_region_name  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.cafile                = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.certfile              = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.collect_timing        = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.insecure              = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.keyfile               = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.number_of_retries     = 60 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.retry_delay           = 1 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.send_service_user_token = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.split_loggers         = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.timeout               = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.verify_ssl            = True {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican.verify_ssl_path       = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.auth_section = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.auth_type = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.cafile   = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.certfile = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.collect_timing = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.insecure = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.keyfile  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.split_loggers = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] barbican_service_user.timeout  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.approle_role_id          = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.approle_secret_id        = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.kv_mountpoint            = secret {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.kv_path                  = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.kv_version               = 2 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.namespace                = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.root_token_id            = **** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.ssl_ca_crt_file          = None {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.timeout                  = 60.0 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.use_ssl                  = False {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:48 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] ******************************************************************************** {{(pid=85982) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 20:42:49 devstack cinder-volume[75875]: DEBUG oslo_concurrency.lockutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Acquiring lock "singleton_lock" {{(pid=75875) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 20:42:49 devstack cinder-volume[75875]: DEBUG oslo_concurrency.lockutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Acquired lock "singleton_lock" {{(pid=75875) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 20:42:49 devstack cinder-volume[75875]: DEBUG oslo_concurrency.lockutils [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Releasing lock "singleton_lock" {{(pid=75875) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 20:42:49 devstack cinder-volume[75875]: WARNING amqp [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 20:42:49 devstack cinder-volume[75875]: WARNING amqp [None req-3bb965cf-9d17-4904-a2de-5f94ca3a1207 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 20:42:49 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:49 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.844s {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:49 devstack cinder-volume[86254]: INFO cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 succeeded
Jul 06 20:42:49 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86254) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:42:49 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.861s {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:42:49 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:49 devstack sudo[86350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:42:49 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:50 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.792s {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:50 devstack cinder-volume[86254]: INFO cinder.volume.driver [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG cinder.volume.driver [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86254) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG oslo_db.sqlalchemy.engines [None req-850b9398-e715-4480-86fe-4c88551e453d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86254) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG dbcounter [-] [86254] Writer thread running {{(pid=86254) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG cinder.db.api [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Building query based on filter {{(pid=86254) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG cinder.image.image_utils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86254) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 20:42:50 devstack cinder-volume[86254]: INFO cinder.keymgr.migration [None req-74e709fb-996f-4c7b-ae0b-be7f35bccbe2 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86254) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86254) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:42:50 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:50 devstack sudo[86385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:42:50 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:51 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:51 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.058s {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:51 devstack cinder-volume[86254]: DEBUG cinder.manager [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Notifying Schedulers of capabilities ... {{(pid=86254) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:42:51 devstack cinder-volume[86254]: INFO cinder.volume.manager [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Driver initialization completed successfully.
Jul 06 20:42:51 devstack cinder-volume[86254]: INFO cinder.manager [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Initiating service 3 cleanup
Jul 06 20:42:51 devstack cinder-volume[86254]: INFO cinder.manager [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Service 3 cleanup completed.
Jul 06 20:42:51 devstack cinder-volume[86254]: DEBUG cinder.service [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Creating RPC server for service cinder-volume {{(pid=86254) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 20:42:51 devstack cinder-volume[86254]: DEBUG cinder.service [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86254) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 20:42:52 devstack cinder-volume[86254]: INFO cinder.volume.manager [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 06 20:42:52 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:42:52 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:42:52 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86254) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:42:52 devstack cinder-volume[86254]: DEBUG cinder.volume.drivers.quobyte [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86254) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:42:52 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86254) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:42:52 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:52 devstack sudo[86488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:42:52 devstack sudo[86488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:52 devstack sudo[86488]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:52 devstack cinder-volume[86254]: DEBUG oslo_concurrency.processutils [None req-850b9398-e715-4480-86fe-4c88551e453d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.953s {{(pid=86254) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:53 devstack cinder-volume[86254]: INFO cinder.volume.manager [None req-850b9398-e715-4480-86fe-4c88551e453d None None] Driver post RPC initialization completed successfully.
Jul 06 20:42:53 devstack cinder-volume[85982]: INFO oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Caught SIGTERM, stopping children
Jul 06 20:42:53 devstack cinder-volume[85982]: DEBUG oslo_concurrency.lockutils [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Acquiring lock "singleton_lock" {{(pid=85982) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 20:42:53 devstack cinder-volume[85982]: DEBUG oslo_concurrency.lockutils [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Acquired lock "singleton_lock" {{(pid=85982) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 20:42:53 devstack cinder-volume[85982]: DEBUG oslo_concurrency.lockutils [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Releasing lock "singleton_lock" {{(pid=85982) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 20:42:53 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Stop services. {{(pid=85982) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Jul 06 20:42:53 devstack cinder-volume[85982]: DEBUG oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Killing children. {{(pid=85982) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Jul 06 20:42:53 devstack cinder-volume[85982]: INFO oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Waiting on 1 children to exit
Jul 06 20:42:54 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Acquiring lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 20:42:54 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Acquired lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 20:42:54 devstack cinder-volume[86254]: DEBUG oslo_concurrency.lockutils [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Releasing lock "singleton_lock" {{(pid=86254) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 20:42:54 devstack cinder-volume[86254]: WARNING amqp [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 20:42:54 devstack cinder-volume[86254]: WARNING amqp [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Received method (60, 30) during closing channel 1. This method will be ignored
Jul 06 20:42:54 devstack cinder-volume[85982]: INFO oslo_service.backend._eventlet.service [None req-44385651-ca88-412f-b456-e5bedbc7be9c None None] Child 86254 exited with status 0
Jul 06 20:42:54 devstack cinder-volume[86599]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Jul 06 20:42:54 devstack cinder-volume[86599]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 20:42:54 devstack cinder-volume[86599]: we strongly recommend against using it for new projects.
Jul 06 20:42:54 devstack cinder-volume[86599]: If you are already using Eventlet, we recommend migrating to a different
Jul 06 20:42:54 devstack cinder-volume[86599]: framework.  For more detail see
Jul 06 20:42:54 devstack cinder-volume[86599]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 20:42:54 devstack cinder-volume[86599]:   import eventlet  # noqa
Jul 06 20:42:56 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
Jul 06 20:42:56 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
Jul 06 20:42:56 devstack cinder-volume[86599]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86599) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
Jul 06 20:42:57 devstack cinder-volume[86599]: INFO dbcounter [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Registered counter for database cinder
Jul 06 20:42:57 devstack cinder-volume[86599]: DEBUG oslo_db.sqlalchemy.engines [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:57 devstack cinder-volume[86599]: DEBUG dbcounter [-] [86599] Writer thread running {{(pid=86599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 20:42:57 devstack cinder-volume[86599]: INFO cinder.rpc [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Jul 06 20:42:57 devstack cinder-volume[86599]: INFO cinder.rpc [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_db.sqlalchemy.engines [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:58 devstack cinder-volume[86599]: INFO cinder.volume.manager [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Determined volume DB was empty at startup.
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG cinder.volume.manager [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86599) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Jul 06 20:42:58 devstack cinder-volume[86599]: WARNING stevedore.named [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Jul 06 20:42:58 devstack cinder-volume[86599]: WARNING castellan.key_manager [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 20:42:58 devstack cinder-volume[86599]: WARNING cinder.keymgr.conf_key_mgr [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Jul 06 20:42:58 devstack cinder-volume[86599]: INFO cinder.volume.manager [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_db.sqlalchemy.engines [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86599) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:58 devstack cinder-volume[86599]: INFO oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Starting 1 workers
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Started child 86721 {{(pid=86599) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Full set of CONF: {{(pid=86599) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] ******************************************************************************** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] Configuration options gathered from: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}}
Jul 06 20:42:58 devstack cinder-volume[86721]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] ================================================================================ {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] allow_availability_zone_fallback = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] allow_compression_on_image_upload = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] allowed_direct_url_schemes     = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] api_rate_limit                 = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] auth_strategy                  = keystone {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_availability_zone      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_host                   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_name                   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_stats_polling_interval = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backup_api_class               = cinder.backup.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backup_name_template           = backup-%s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backup_use_same_host           = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backup_use_temp_snapshot       = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] chap_password                  = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] chap_username                  =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_internal_tenant_project_id = 22426243f834473da7ef617fad5606d6 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_internal_tenant_user_id = 0c301431c2624d9898e5321e458e06d6 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cluster                        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] compression_format             = gzip {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] config_dir                     = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] config_source                  = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] control_exchange               = openstack {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] debug                          = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] default_availability_zone      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] default_group_type             = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] default_volume_type            = QuobyteHD {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] disk_geometry                  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] driver_client_cert             = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] driver_client_cert_key         = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] driver_data_namespace          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] driver_ssl_cert_path           = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] driver_ssl_cert_verify         = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] driver_use_ssl                 = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] enable_new_services            = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] enable_unsupported_driver      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] enforce_multipath_for_image_xfer = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] filter_function                = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_api_insecure            = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_api_servers             = ['http://192.168.122.231/image'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_api_ssl_compression     = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_ca_certificates_file    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_certfile                = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_keyfile                 = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_num_retries             = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance_request_timeout         = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] goodness_function              = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] graceful_shutdown_timeout      = 5 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] group_api_class                = cinder.group.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] host                           = devstack {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_compress_on_upload       = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_conversion_address_space_limit = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_conversion_cpu_limit     = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_conversion_disable       = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_upload_use_cinder_backend = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_upload_use_internal_tenant = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Starting volume driver QuobyteDriver (1.1.14)
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_volume_cache_enabled     = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86721) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_volume_cache_max_count   = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] image_volume_cache_max_size_gb = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] init_host_max_objects_retrieval = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] iscsi_target_flags             =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] iscsi_write_cache              = on {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] iser_helper                    = tgtadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] iser_ip_address                = 192.168.122.231 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] iser_port                      = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_color                      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_config_append              = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_dir                        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_file                       = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_options                    = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_rotate_interval            = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_rotate_interval_type       = days {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] log_rotation_type              = none {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] max_age                        = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] max_logfile_count              = 30 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] max_logfile_size_mb            = 200 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] max_over_subscription_ratio    = 20.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] message_reap_interval          = 86400 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] message_ttl                    = 2592000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] migration_create_volume_timeout_secs = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] monkey_patch                   = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] monkey_patch_modules           = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] my_ip                          = 192.168.122.231 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] no_snapshot_gb_quota           = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] num_iser_scan_tries            = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] num_shell_tries                = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] num_volume_device_scan_tries   = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] nvmeof_conn_info_version       = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] nvmet_ns_id                    = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] nvmet_port_id                  = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] osapi_max_limit                = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] osapi_volume_ext_list          = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] osapi_volume_listen_port       = 8776 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] osapi_volume_use_ssl           = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] osapi_volume_workers           = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] per_volume_size_limit          = -1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] periodic_fuzzy_delay           = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] periodic_interval              = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] public_endpoint                = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] publish_errors                 = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] quota_backup_gigabytes         = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] quota_backups                  = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] quota_gigabytes                = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] quota_groups                   = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] quota_snapshots                = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] quota_volumes                  = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] rate_limit_burst               = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] rate_limit_except_level        = CRITICAL {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] rate_limit_interval            = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] reinit_driver_count            = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] replication_device             = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] report_discard_supported       = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] report_interval                = 120 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] reservation_clean_interval     = 86400 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] reservation_expire             = 86400 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] reserved_image_namespaces      = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] reserved_percentage            = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] rpc_response_timeout           = 120 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] run_external_periodic_tasks    = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] scst_target_driver             = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] scst_target_iqn_name           = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_down_time              = 720 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] shell_completion               = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] snapshot_name_template         = snapshot-%s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] split_loggers                  = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] state_path                     = /opt/stack/data/cinder {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] storage_availability_zone      = nova {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] storage_protocol               = iSCSI {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] syslog_log_facility            = LOG_USER {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] target_helper                  = lioadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] target_ip_address              = 192.168.122.231 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] target_port                    = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] target_protocol                = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] target_secondary_ip_addresses  = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] trace_flags                    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] transport_url                  = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] until_refresh                  = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] use_chap_auth                  = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] use_default_quota_class        = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] use_journal                    = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] use_json                       = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] use_multipath_for_image_xfer   = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] use_stderr                     = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] use_syslog                     = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] verify_glance_signatures       = enabled {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_api_class               = cinder.volume.api.API {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_backend_name            = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_clear                   = zero {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_clear_ionice            = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_clear_size              = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_copy_bps_limit          = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_dd_blocksize            = 1M {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_name_template           = volume-%s {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_service_inithost_offload = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volume_usage_audit_period      = month {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] zoning_mode                    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_concurrency.disable_process_locking = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.auth_section = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.auth_type   = password {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.auth_version = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.cache       = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.certfile    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.include_service_catalog = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.insecure    = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.interface   = public {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.keyfile     = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_password =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86721) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Jul 06 20:42:58 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Jul 06 20:42:58 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcache_username =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.region_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.service_type = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.231/identity {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.backend                  = dogpile.cache.null {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.backend_argument         = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Running cmd (subprocess): mount.quobyte {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.backend_expiration_time  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.config_prefix            = cache.oslo {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.debug_cache_backend      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.enable_retry_client      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.enable_socket_keepalive  = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.enabled                  = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.expiration_time          = 600 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.hashclient_retry_attempts = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.memcache_dead_retry      = 300 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.memcache_sasl_enabled    = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.password                 = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.proxies                  = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.redis_db                 = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.redis_server             = localhost:6379 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.retry_attempts           = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.retry_delay              = 0.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.socket_keepalive_count   = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.socket_keepalive_idle    = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.socket_keepalive_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.socket_timeout           = 1.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.tls_allowed_ciphers      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.tls_cafile               = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.tls_certfile             = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.tls_enabled              = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.tls_keyfile              = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cache.username                 = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] coordination.backend_url       = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.asyncio_connection    = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.asyncio_slave_connection = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.backend               = sqlalchemy {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.connection            = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.connection_debug      = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.connection_parameters =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.connection_recycle_time = 3600 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.connection_trace      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.db_inc_retry_interval = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.db_max_retries        = 20 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.db_max_retry_interval = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.db_retry_interval     = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.max_overflow          = 50 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.max_pool_size         = 5 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.max_retries           = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.mysql_wsrep_sync_wait = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.pool_timeout          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.retry_interval        = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.slave_connection      = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.sqlite_synchronous    = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.synchronous_reader    = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] database.use_db_reconnect      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.connection_string     = messaging:// {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.enabled               = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.es_doc_type           = notification {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.es_scroll_size        = 10000 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.es_scroll_time        = 2m {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.filter_error_trace    = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.hmac_keys             = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.sentinel_service_name = mymaster {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.socket_timeout        = 0.1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.trace_requests        = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler.trace_sqlalchemy      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler_jaeger.process_tags   = {} {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler_jaeger.service_name_prefix = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] profiler_otlp.service_name_prefix = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.enforce_new_defaults = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.enforce_scope      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.policy_default_rule = default {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] privsep_osbrick.group          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] privsep_osbrick.helper_command = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] privsep_osbrick.user           = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_sys_admin.group         = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_sys_admin.helper_command = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] cinder_sys_admin.user          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.auth_section      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.auth_type         = password {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.cafile            = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.certfile          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.collect_timing    = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.insecure          = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.keyfile           = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.send_service_user_token = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.split_loggers     = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] service_user.timeout           = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.auth_section            = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.auth_type               = password {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.certfile                = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.collect_timing          = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.insecure                = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.keyfile                 = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.region_name             = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.split_loggers           = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] glance.timeout                 = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.backend_availability_zone = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.chap_password = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.chap_username =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.disk_geometry = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.driver_client_cert = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.driver_client_cert_key = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.driver_data_namespace = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.driver_use_ssl = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.extra_capabilities = {} {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.filter_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.goodness_function = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.iscsi_target_flags =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.iscsi_write_cache = on {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.iser_ip_address = 192.168.122.231 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.iser_port     = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack quobyte-client[86722]: Reading configuration file: /etc/quobyte/client.cfg
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_host      =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_login     = admin {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack quobyte-client[86722]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_mount_options = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_password  = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_private_key =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_share_path =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] CMD "mount.quobyte" returned: 1 in 0.056s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.num_shell_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.quobyte_volume_url = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.replication_device = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.report_discard_supported = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.reserved_percentage = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.target_helper = tgtadm {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.target_ip_address = 192.168.122.231 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.target_port   = 3260 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.target_protocol = iscsi {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.trace_flags   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.unique_fqdn_network = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.use_chap_auth = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_backend_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_clear  = zero {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_clear_ionice = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_clear_size = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_reports.file_event_handler = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_reports.log_dir           = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.backend_availability_zone = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.backend_host         = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.chap_password        = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.chap_username        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.disk_geometry        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.driver_client_cert   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.driver_data_namespace = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.extra_capabilities   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.filter_function      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.goodness_function    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.iser_helper          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.iser_ip_address      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.iser_port            = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack sudo[86723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_host             = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_login            = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_mount_options    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_password         = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_private_key      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_share_path       = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.num_shell_tries      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.replication_device   = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.report_discard_supported = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.reserved_percentage  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.scst_target_driver   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.storage_protocol     = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.target_helper        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.target_ip_address    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.target_port          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.target_prefix        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.target_protocol      = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.trace_flags          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.use_chap_auth        = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_clear         = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_clear_size    = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] QuobyteHD.volumes_dir          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_notifications.driver = [] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_notifications.retry = -1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] key_manager.fixed_key          = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.barbican_api_version  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.barbican_endpoint     = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.barbican_endpoint_type = public {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.barbican_region_name  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.cafile                = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.certfile              = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.collect_timing        = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.insecure              = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.keyfile               = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.number_of_retries     = 60 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.retry_delay           = 1 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.send_service_user_token = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.split_loggers         = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.timeout               = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.verify_ssl            = True {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican.verify_ssl_path       = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.auth_section = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.auth_type = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.cafile   = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.certfile = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.collect_timing = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.insecure = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.keyfile  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.split_loggers = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] barbican_service_user.timeout  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.approle_role_id          = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.approle_secret_id        = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.kv_mountpoint            = secret {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.kv_path                  = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.kv_version               = 2 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.namespace                = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.root_token_id            = **** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.ssl_ca_crt_file          = None {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.timeout                  = 60.0 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.use_ssl                  = False {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}}
Jul 06 20:42:58 devstack cinder-volume[86599]: DEBUG oslo_service.backend._eventlet.service [None req-c2769518-a958-42a4-81d2-4e70b2a37874 None None] ******************************************************************************** {{(pid=86599) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}}
Jul 06 20:42:59 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.628s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:59 devstack cinder-volume[86721]: INFO cinder.volume.driver [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Driver hasn't implemented _init_vendor_properties()
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.volume.driver [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86721) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_db.sqlalchemy.engines [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86721) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writer thread running {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.db.api [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Building query based on filter {{(pid=86721) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86721) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:59 devstack cinder-volume[86721]: INFO cinder.keymgr.migration [None req-b42988ee-1e1c-4f55-8963-8a1807dad416 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Jul 06 20:42:59 devstack sudo[86734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:42:59 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:42:59 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.635s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:42:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Driver initialization completed successfully.
Jul 06 20:42:59 devstack cinder-volume[86721]: INFO cinder.manager [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Initiating service 3 cleanup
Jul 06 20:42:59 devstack cinder-volume[86721]: INFO cinder.manager [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Service 3 cleanup completed.
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.service [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Creating RPC server for service cinder-volume {{(pid=86721) start /opt/stack/cinder/cinder/service.py:231}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.service [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86721) start /opt/stack/cinder/cinder/service.py:237}}
Jul 06 20:42:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:42:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:42:59 devstack sudo[86739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:42:59 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:43:00 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root
Jul 06 20:43:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.642s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:43:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-71049d3f-647e-424c-aeb5-fbf74d594522 None None] Driver post RPC initialization completed successfully.
Jul 06 20:43:08 devstack cinder-volume[86599]: DEBUG dbcounter [-] [86599] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86599) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:43:09 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:43:10 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=2 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:43:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:43:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 6 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:43:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:44:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:44:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:44:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:44:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:44:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:44:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:44:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:44:37 devstack sudo[87181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:44:37 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:44:38 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root
Jul 06 20:44:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.671s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:44:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:44:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:44:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 6 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:44:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:45:10 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:45:10 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:45:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:45:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:45:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:45:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:45:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:45:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:45:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:45:37 devstack sudo[87501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:45:37 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:45:38 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root
Jul 06 20:45:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.261s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:45:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Flow 'volume_create_manager' (29f793f2-b5b9-4437-a32a-17ef22558a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91432662-96d2-4014-8652-77b86549e8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91432662-96d2-4014-8652-77b86549e8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-379944165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c0d349-d295-421f-8573-59afdd947b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe88382d736472aa527a47178c44a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:56Z,use_quota=True,user_id='d0d06ac0923b4fbc8022b2a089b4511c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a69b4f6-2e82-42f1-89f0-fcc3071513ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a69b4f6-2e82-42f1-89f0-fcc3071513ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447d661f-81dd-4bb6-8509-3f0dd42680a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (447d661f-81dd-4bb6-8509-3f0dd42680a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95c0d349-d295-421f-8573-59afdd947b8b', 'volume_name': 'volume-95c0d349-d295-421f-8573-59afdd947b8b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b364e2b4-2675-4699-9947-2fb966c59ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b364e2b4-2675-4699-9947-2fb966c59ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fdd4d8-0b98-417e-8460-fb3c2950b636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:45:56 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Volume 95c0d349-d295-421f-8573-59afdd947b8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95c0d349-d295-421f-8573-59afdd947b8b', 'volume_size': 1}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:45:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-379944165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95c0d349-d295-421f-8573-59afdd947b8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbe88382d736472aa527a47178c44a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:45:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:45:56Z,use_quota=True,user_id='d0d06ac0923b4fbc8022b2a089b4511c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Creating volume 95c0d349-d295-421f-8573-59afdd947b8b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:45:56 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:45:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:45:56 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b 1073741824
Jul 06 20:45:56 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:45:57 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Jul 06 20:45:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b 1073741824" returned: 0 in 1.374s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:45:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:45:57 devstack sudo[88160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b
Jul 06 20:45:57 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:45:58 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root
Jul 06 20:45:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b" returned: 0 in 0.746s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:45:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:45:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:45:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24fdd4d8-0b98-417e-8460-fb3c2950b636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95c0d349-d295-421f-8573-59afdd947b8b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:45:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a8a962-df4c-46c0-b873-313b95ccd8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:45:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Volume volume-95c0d349-d295-421f-8573-59afdd947b8b (95c0d349-d295-421f-8573-59afdd947b8b): created successfully
Jul 06 20:45:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a8a962-df4c-46c0-b873-313b95ccd8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:45:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Flow 'volume_create_manager' (29f793f2-b5b9-4437-a32a-17ef22558a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:45:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-2654240a-67fe-4240-ae84-6d01db9ed8d7 tempest-DeleteServersTestJSON-1689847053 None] Created volume successfully.
Jul 06 20:46:08 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:46:08 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Flow 'volume_create_manager' (e2ca59a8-35f1-4bf5-a2b5-c84d5f505ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82f5e35-44b6-4b7e-9f98-28c3c431fec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c82f5e35-44b6-4b7e-9f98-28c3c431fec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1355211178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f2d89f-3ede-480b-a86b-9abf29a91b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf3f6edff34db9be21e7d11a447133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:10Z,use_quota=True,user_id='198fbdcc88b34f068db12b943be5b2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9cb3da-0f30-442d-bed8-82ea8c9094b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab9cb3da-0f30-442d-bed8-82ea8c9094b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9467c6e8-42a1-4366-9622-9d0507c25cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9467c6e8-42a1-4366-9622-9d0507c25cd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18f2d89f-3ede-480b-a86b-9abf29a91b94', 'volume_name': 'volume-18f2d89f-3ede-480b-a86b-9abf29a91b94', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb9f6a5-7b56-4071-9980-c2e2eca41947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb9f6a5-7b56-4071-9980-c2e2eca41947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16930433-1a25-43b5-bd12-87bce9478ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Volume 18f2d89f-3ede-480b-a86b-9abf29a91b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18f2d89f-3ede-480b-a86b-9abf29a91b94', 'volume_size': 1}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1355211178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18f2d89f-3ede-480b-a86b-9abf29a91b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccbf3f6edff34db9be21e7d11a447133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:10Z,use_quota=True,user_id='198fbdcc88b34f068db12b943be5b2d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Creating volume 18f2d89f-3ede-480b-a86b-9abf29a91b94 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:46:10 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:10 devstack sudo[88290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94 1073741824
Jul 06 20:46:10 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:10 devstack cinder-volume[86721]: WARNING py.warnings [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Jul 06 20:46:10 devstack cinder-volume[86721]:   .first()
Jul 06 20:46:10 devstack cinder-volume[86721]: 
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Flow 'volume_create_manager' (96a192f4-81b9-4f09-aced-dbac46bf1d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a73a69e-dfcb-4973-9fb7-d9f066512780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a73a69e-dfcb-4973-9fb7-d9f066512780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1364454890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a623574d-eca5-469b-9f6d-5e3ce8ed2b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ce36d4f3264547a4332c194e1c1f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:11Z,use_quota=True,user_id='fa100a75a4d04a2395e761679d78ee7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633050ff-5102-4790-a479-7247b90c4214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (633050ff-5102-4790-a479-7247b90c4214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc21d32-a2d9-4305-b2bd-70348d15a773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccc21d32-a2d9-4305-b2bd-70348d15a773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a623574d-eca5-469b-9f6d-5e3ce8ed2b57', 'volume_name': 'volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83516f2e-7b61-4b44-a20b-0d2b9ac0f0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83516f2e-7b61-4b44-a20b-0d2b9ac0f0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e89f6b1-8f1d-4afb-99a7-aecfaa1d766c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:10 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Volume a623574d-eca5-469b-9f6d-5e3ce8ed2b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57', 'volume_size': 1}
Jul 06 20:46:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:12 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94 1073741824" returned: 0 in 1.846s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:12 devstack sudo[88296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94
Jul 06 20:46:12 devstack sudo[88296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:13 devstack sudo[88296]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94" returned: 0 in 1.127s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] <== create_volume: return (3072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.078s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.935s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:13 devstack cinder-volume[86721]: INFO oslo.privsep.daemon [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpqu0bdpeu/privsep.sock']
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16930433-1a25-43b5-bd12-87bce9478ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18f2d89f-3ede-480b-a86b-9abf29a91b94', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:13 devstack sudo[88299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpqu0bdpeu/privsep.sock
Jul 06 20:46:13 devstack sudo[88299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c663f7-c36d-4727-85d6-49ed68b107ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:13 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Volume volume-18f2d89f-3ede-480b-a86b-9abf29a91b94 (18f2d89f-3ede-480b-a86b-9abf29a91b94): created successfully
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3c663f7-c36d-4727-85d6-49ed68b107ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Flow 'volume_create_manager' (e2ca59a8-35f1-4bf5-a2b5-c84d5f505ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:46:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-446901f1-0bad-4aeb-bd5f-ccb8a49dcc49 tempest-ServerRescueNegativeTestJSON-1243353772 None] Created volume successfully.
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 20:46:14 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log: 
Jul 06 20:46:16 devstack cinder-volume[86721]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
Jul 06 20:46:18 devstack sudo[88299]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:18 devstack cinder-volume[86721]: INFO oslo.privsep.daemon [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Spawned new privsep daemon via rootwrap
Jul 06 20:46:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Accepted privsep connection to /tmp/tmpqu0bdpeu/privsep.sock {{(pid=86721) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Jul 06 20:46:18 devstack cinder-volume[86721]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 06 20:46:18 devstack cinder-volume[86721]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 06 20:46:18 devstack cinder-volume[86721]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 06 20:46:18 devstack cinder-volume[86721]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88305
Jul 06 20:46:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[19874c4b-5aef-4c72-9296-2d6f7bdbe51b]: (2,) {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:46:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[124f3039-a5f7-471f-84b9-93ed250e8f36]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:46:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:18 devstack sudo[88308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b
Jul 06 20:46:18 devstack sudo[88308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:21 devstack sudo[88308]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b" returned: 0 in 2.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 7.815s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.443s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1364454890',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a623574d-eca5-469b-9f6d-5e3ce8ed2b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='94ce36d4f3264547a4332c194e1c1f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:11Z,use_quota=True,user_id='fa100a75a4d04a2395e761679d78ee7a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Creating volume a623574d-eca5-469b-9f6d-5e3ce8ed2b57 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:46:21 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:21 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57 1073741824
Jul 06 20:46:21 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-95c0d349-d295-421f-8573-59afdd947b8b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54e689d7-f686-4d45-826e-4dbf210dd78d', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:46:22 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-ac16c287-0390-4794-9a23-ef48515cc7cb req-98c8c1f6-b1c9-4e8a-944b-ad079fee5fdc tempest-DeleteServersTestJSON-1689847053 None] attachment_update completed successfully.
Jul 06 20:46:24 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57 1073741824" returned: 0 in 2.610s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:24 devstack sudo[88563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57
Jul 06 20:46:24 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:25 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57" returned: 0 in 1.694s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] <== create_volume: return (4420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:46:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.425s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e89f6b1-8f1d-4afb-99a7-aecfaa1d766c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058c0e91-162c-4261-93e8-b97517260813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Volume volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57 (a623574d-eca5-469b-9f6d-5e3ce8ed2b57): created successfully
Jul 06 20:46:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058c0e91-162c-4261-93e8-b97517260813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Flow 'volume_create_manager' (96a192f4-81b9-4f09-aced-dbac46bf1d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:46:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d464f8aa-c5ac-4bf5-a05c-6c1ae9af2fa4 tempest-VolumesAdminNegativeTest-943839591 None] Created volume successfully.
Jul 06 20:46:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Acquiring lock "cinder-a623574d-eca5-469b-9f6d-5e3ce8ed2b57-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:46:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Lock "cinder-a623574d-eca5-469b-9f6d-5e3ce8ed2b57-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:46:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Acquiring lock "cinder-quobyte-a623574d-eca5-469b-9f6d-5e3ce8ed2b57" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:46:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Lock "cinder-quobyte-a623574d-eca5-469b-9f6d-5e3ce8ed2b57" acquired by "delete_volume" :: waited 0.040s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:46:27 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[162f3af3-2f7f-4e7c-8b6e-9baf9fa730ec]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:46:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:27 devstack sudo[88766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57
Jul 06 20:46:27 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:28 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57" returned: 0 in 1.488s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:28 devstack sudo[88826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57
Jul 06 20:46:28 devstack sudo[88826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:29 devstack sudo[88826]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a623574d-eca5-469b-9f6d-5e3ce8ed2b57" returned: 0 in 1.087s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Lock "cinder-quobyte-a623574d-eca5-469b-9f6d-5e3ce8ed2b57" released by "delete_volume" :: held 2.727s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:46:30 devstack cinder-volume[86721]: WARNING cinder.quota [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:46:30 devstack cinder-volume[86721]: WARNING cinder.quota [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Created reservations ['115e183a-59dc-4cfb-a5b1-7cc77c7ad911', '2f4c32a8-7534-458c-88d5-c0b88b337052', '6d43a68c-ca27-4db1-bb7a-8f7a9b6b1dd1', '1cfa5e14-d72a-44c2-8535-369d66b2b20e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:30 devstack sudo[88836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:46:30 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:31 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.357s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:31 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:46:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Deleted volume successfully.
Jul 06 20:46:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a122181-d40e-4e71-9758-5adef8e0ad6e tempest-VolumesAdminNegativeTest-943839591 None] Lock "cinder-a623574d-eca5-469b-9f6d-5e3ce8ed2b57-delete_volume" released by "delete_volume" :: held 4.682s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:46:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-fafcd570-e1d2-423c-9563-a067e9ab4d4c req-de30158f-ecdd-4395-bdd5-f71319d1e275 tempest-DeleteServersTestJSON-1689847053 None] Terminate volume connection completed successfully.
Jul 06 20:46:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-fafcd570-e1d2-423c-9563-a067e9ab4d4c req-de30158f-ecdd-4395-bdd5-f71319d1e275 tempest-DeleteServersTestJSON-1689847053 None] Deleting attachment 54e689d7-f686-4d45-826e-4dbf210dd78d. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:46:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:46:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:37 devstack sudo[88936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:46:37 devstack sudo[88936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:38 devstack sudo[88936]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.970s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:46:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:46:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:46:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Acquiring lock "cinder-18f2d89f-3ede-480b-a86b-9abf29a91b94-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "cinder-18f2d89f-3ede-480b-a86b-9abf29a91b94-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Acquiring lock "cinder-quobyte-18f2d89f-3ede-480b-a86b-9abf29a91b94" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "cinder-quobyte-18f2d89f-3ede-480b-a86b-9abf29a91b94" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de18ab3-4e4b-4a16-9bd7-d5558775bcda]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:40 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94
Jul 06 20:46:40 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Acquiring lock "cinder-95c0d349-d295-421f-8573-59afdd947b8b-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Lock "cinder-95c0d349-d295-421f-8573-59afdd947b8b-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Acquiring lock "cinder-quobyte-95c0d349-d295-421f-8573-59afdd947b8b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Lock "cinder-quobyte-95c0d349-d295-421f-8573-59afdd947b8b" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7425bdb1-e3c4-40bf-bfff-7fc98ea78a39]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:46:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:40 devstack sudo[88944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b
Jul 06 20:46:40 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:41 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94" returned: 0 in 1.406s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:41 devstack sudo[88951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94
Jul 06 20:46:41 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:42 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b" returned: 0 in 1.411s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:42 devstack sudo[88956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b
Jul 06 20:46:42 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:42 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-18f2d89f-3ede-480b-a86b-9abf29a91b94" returned: 0 in 1.182s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "cinder-quobyte-18f2d89f-3ede-480b-a86b-9abf29a91b94" released by "delete_volume" :: held 2.698s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Created reservations ['2d3ec4f8-701e-480f-9d78-9afb1a97d430', 'c1c32c46-cbbd-49cf-b439-79c8af37f772', 'c5b819c0-416c-424b-b731-6d87bdd2f71b', 'c51dc71c-6259-42c0-9aa0-b11239e36f4d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:43 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:46:43 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:43 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-95c0d349-d295-421f-8573-59afdd947b8b" returned: 0 in 1.209s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Lock "cinder-quobyte-95c0d349-d295-421f-8573-59afdd947b8b" released by "delete_volume" :: held 2.706s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Created reservations ['a11f330c-4076-4e73-b5cb-79e527667935', 'b7b839dc-d9be-4aed-9796-613b2c712c7c', '0d486770-ccdf-400f-9964-79138480c3f7', 'fdabffb6-e07e-4ee2-a968-8e5d6ad04c41'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:43 devstack sudo[88963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:46:43 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:44 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.293s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:44 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:46:44 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Deleted volume successfully.
Jul 06 20:46:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c3822d1-5890-4f02-adfd-4d9edcdf891b tempest-ServerRescueNegativeTestJSON-1243353772 None] Lock "cinder-18f2d89f-3ede-480b-a86b-9abf29a91b94-delete_volume" released by "delete_volume" :: held 4.512s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:46:45 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.373s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:45 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:46:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Deleted volume successfully.
Jul 06 20:46:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d8966a6-1e8d-466a-82e0-e39548dd9698 tempest-DeleteServersTestJSON-1689847053 None] Lock "cinder-95c0d349-d295-421f-8573-59afdd947b8b-delete_volume" released by "delete_volume" :: held 4.630s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:46:54 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=33,cinder:SELECT=23,cinder:INSERT=11,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=28,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=3 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Flow 'volume_create_manager' (e792286e-cbc3-498f-ab36-2a6a95a17a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b444bee-ee78-483e-a1b2-13341c305f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b444bee-ee78-483e-a1b2-13341c305f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-367997336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13779ad6-8343-4698-abf5-a3edd9ad8597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1896f11dafc45b1b9d0863cf718a14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:55Z,use_quota=True,user_id='f12ca2f00ea6403e8936b68aeb6284ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7f49f6-89ba-433e-bdda-ec8454289b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff7f49f6-89ba-433e-bdda-ec8454289b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6c0fa8-7eab-4997-b2b5-ff5527e8313e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6c0fa8-7eab-4997-b2b5-ff5527e8313e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13779ad6-8343-4698-abf5-a3edd9ad8597', 'volume_name': 'volume-13779ad6-8343-4698-abf5-a3edd9ad8597', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22f6fa5-f0f7-46bd-a111-6d0419773e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d22f6fa5-f0f7-46bd-a111-6d0419773e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf8bc8f-cc75-4e6e-8d47-ae9a6d468cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Volume 13779ad6-8343-4698-abf5-a3edd9ad8597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13779ad6-8343-4698-abf5-a3edd9ad8597', 'volume_size': 1}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-367997336',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13779ad6-8343-4698-abf5-a3edd9ad8597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1896f11dafc45b1b9d0863cf718a14e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:46:55Z,use_quota=True,user_id='f12ca2f00ea6403e8936b68aeb6284ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Creating volume 13779ad6-8343-4698-abf5-a3edd9ad8597 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:46:55 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:46:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:55 devstack sudo[89012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597 1073741824
Jul 06 20:46:55 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:56 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597 1073741824" returned: 0 in 1.314s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:46:57 devstack sudo[89038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597
Jul 06 20:46:57 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:46:57 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root
Jul 06 20:46:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597" returned: 0 in 0.846s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:46:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:46:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:46:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cf8bc8f-cc75-4e6e-8d47-ae9a6d468cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13779ad6-8343-4698-abf5-a3edd9ad8597', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa51302b-3cba-46ac-bbdc-fd81ec67b97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:46:57 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Volume volume-13779ad6-8343-4698-abf5-a3edd9ad8597 (13779ad6-8343-4698-abf5-a3edd9ad8597): created successfully
Jul 06 20:46:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa51302b-3cba-46ac-bbdc-fd81ec67b97f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:46:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Flow 'volume_create_manager' (e792286e-cbc3-498f-ab36-2a6a95a17a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:46:57 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9fdd3972-9f0d-4228-a36c-d3268ca92a9e tempest-TaggedAttachmentsTest-459403444 None] Created volume successfully.
Jul 06 20:47:10 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:47:10 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:47:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:47:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:47:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:47:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:47:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:47:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:47:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:47:37 devstack sudo[89299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:47:37 devstack sudo[89299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:47:39 devstack sudo[89299]: pam_unix(sudo:session): session closed for user root
Jul 06 20:47:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.693s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:47:39 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:47:39 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:47:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:47:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Flow 'volume_create_manager' (b00b3e97-20f8-4998-b33c-61882cf9e61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a39477c-684e-4929-9627-6775503d9528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a39477c-684e-4929-9627-6775503d9528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1743962999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3241f8f-d378-4f96-ab09-9f8774228409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb77e4426d1468cade531ba3259126b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:10Z,use_quota=True,user_id='f9c4dc5306b646a39d8dd756ca10f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962aa78-1803-40cd-aec8-59c2973309f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c962aa78-1803-40cd-aec8-59c2973309f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec4bd4-cc22-40ed-88f1-0c6f0ba94a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24ec4bd4-cc22-40ed-88f1-0c6f0ba94a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3241f8f-d378-4f96-ab09-9f8774228409', 'volume_name': 'volume-a3241f8f-d378-4f96-ab09-9f8774228409', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d9a3dc-6b42-4944-9dd6-35fdbf469738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d9a3dc-6b42-4944-9dd6-35fdbf469738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e42f4c6-5c0a-47a8-878f-6f1f7bdbd9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:10 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Volume a3241f8f-d378-4f96-ab09-9f8774228409: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3241f8f-d378-4f96-ab09-9f8774228409', 'volume_size': 1}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1743962999',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3241f8f-d378-4f96-ab09-9f8774228409,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb77e4426d1468cade531ba3259126b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:10Z,use_quota=True,user_id='f9c4dc5306b646a39d8dd756ca10f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Creating volume a3241f8f-d378-4f96-ab09-9f8774228409 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:48:10 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:48:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:10 devstack sudo[89773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409 1073741824
Jul 06 20:48:10 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:11 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409 1073741824" returned: 0 in 1.092s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:11 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409
Jul 06 20:48:11 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:12 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409" returned: 0 in 0.650s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:48:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e42f4c6-5c0a-47a8-878f-6f1f7bdbd9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3241f8f-d378-4f96-ab09-9f8774228409', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe56190-ebb3-448c-9694-2a74719cf37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Volume volume-a3241f8f-d378-4f96-ab09-9f8774228409 (a3241f8f-d378-4f96-ab09-9f8774228409): created successfully
Jul 06 20:48:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe56190-ebb3-448c-9694-2a74719cf37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Flow 'volume_create_manager' (b00b3e97-20f8-4998-b33c-61882cf9e61a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d168e3ac-a225-4b0d-9b30-5507929f35a8 tempest-ServersNegativeTestJSON-1523827492 None] Created volume successfully.
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Flow 'volume_create_manager' (6a7950d2-449f-4805-8a23-3ec146412b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff16b15-1cad-45f5-b6cd-109005c7a3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cff16b15-1cad-45f5-b6cd-109005c7a3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2131766850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cc68a9-4b32-4666-97a7-0eeb25c131e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb77e4426d1468cade531ba3259126b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:15Z,use_quota=True,user_id='f9c4dc5306b646a39d8dd756ca10f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852a6f8-0230-4e6e-ad98-db405f2a433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f852a6f8-0230-4e6e-ad98-db405f2a433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bafcbe-620c-4fec-b6b6-6797d85a0cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9bafcbe-620c-4fec-b6b6-6797d85a0cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83cc68a9-4b32-4666-97a7-0eeb25c131e7', 'volume_name': 'volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cee080-e80a-410f-a980-bfdbb71860fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8cee080-e80a-410f-a980-bfdbb71860fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8281562c-4362-4548-aace-7d0c049c29dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:14 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Volume 83cc68a9-4b32-4666-97a7-0eeb25c131e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7', 'volume_size': 1}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2131766850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83cc68a9-4b32-4666-97a7-0eeb25c131e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb77e4426d1468cade531ba3259126b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:15Z,use_quota=True,user_id='f9c4dc5306b646a39d8dd756ca10f41b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Creating volume 83cc68a9-4b32-4666-97a7-0eeb25c131e7 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:48:14 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:48:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:14 devstack sudo[89827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7 1073741824
Jul 06 20:48:14 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:15 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7 1073741824" returned: 0 in 0.840s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:15 devstack sudo[89832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7
Jul 06 20:48:15 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:16 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7" returned: 0 in 0.663s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:48:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8281562c-4362-4548-aace-7d0c049c29dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0561e061-f04e-4d4b-9614-a879c12b8822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:16 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Volume volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7 (83cc68a9-4b32-4666-97a7-0eeb25c131e7): created successfully
Jul 06 20:48:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0561e061-f04e-4d4b-9614-a879c12b8822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Flow 'volume_create_manager' (6a7950d2-449f-4805-8a23-3ec146412b16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4dcac62e-b278-4ee1-aa57-0ef64137d60d tempest-ServersNegativeTestJSON-1523827492 None] Created volume successfully.
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "cinder-83cc68a9-4b32-4666-97a7-0eeb25c131e7-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-83cc68a9-4b32-4666-97a7-0eeb25c131e7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-05945bcb-db8c-4580-83a0-fa5646393d17 req-4429ec78-16c2-4b87-bdb1-ce59c90345f0 tempest-TaggedAttachmentsTest-459403444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-05945bcb-db8c-4580-83a0-fa5646393d17 req-4429ec78-16c2-4b87-bdb1-ce59c90345f0 tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a945f3-dbb4-4e0e-be64-805a12047d31]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-05945bcb-db8c-4580-83a0-fa5646393d17 req-4429ec78-16c2-4b87-bdb1-ce59c90345f0 tempest-TaggedAttachmentsTest-459403444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "cinder-quobyte-83cc68a9-4b32-4666-97a7-0eeb25c131e7" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-quobyte-83cc68a9-4b32-4666-97a7-0eeb25c131e7" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[895d78ce-c03a-4328-95d9-5ea120b6e477]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:17 devstack sudo[89848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597
Jul 06 20:48:17 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:17 devstack sudo[89849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7
Jul 06 20:48:17 devstack sudo[89849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Flow 'volume_create_manager' (76852a46-fb15-40e0-bad0-de6afd4460dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf11ff6-b537-4608-b521-92d58dce183a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caf11ff6-b537-4608-b521-92d58dce183a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-174041816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65191642-911c-4d61-b61a-d2d8e2ef3634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb8bcae0dd14b23a448f2a399aafc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:18Z,use_quota=True,user_id='913139d7cdee4751b245786106906e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c59b46-087b-4bd5-9434-9d694619a5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52c59b46-087b-4bd5-9434-9d694619a5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb7ac9c-c8bb-47b7-b202-3a1c2b24df0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb7ac9c-c8bb-47b7-b202-3a1c2b24df0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65191642-911c-4d61-b61a-d2d8e2ef3634', 'volume_name': 'volume-65191642-911c-4d61-b61a-d2d8e2ef3634', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046483a0-0aa1-4cdb-94bd-374262b9ac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (046483a0-0aa1-4cdb-94bd-374262b9ac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f231fd7e-ed31-4cbb-b745-01d8006758a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:18 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Volume 65191642-911c-4d61-b61a-d2d8e2ef3634: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65191642-911c-4d61-b61a-d2d8e2ef3634', 'volume_size': 1}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:18 devstack sudo[89849]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7" returned: 0 in 1.119s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:18 devstack sudo[89858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7
Jul 06 20:48:18 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:18 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-05945bcb-db8c-4580-83a0-fa5646393d17 req-4429ec78-16c2-4b87-bdb1-ce59c90345f0 tempest-TaggedAttachmentsTest-459403444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597" returned: 0 in 1.273s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-05945bcb-db8c-4580-83a0-fa5646393d17 req-4429ec78-16c2-4b87-bdb1-ce59c90345f0 tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.326s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.315s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-174041816',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65191642-911c-4d61-b61a-d2d8e2ef3634,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bb8bcae0dd14b23a448f2a399aafc89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:18Z,use_quota=True,user_id='913139d7cdee4751b245786106906e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Creating volume 65191642-911c-4d61-b61a-d2d8e2ef3634 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:48:18 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:18 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 1073741824
Jul 06 20:48:18 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-05945bcb-db8c-4580-83a0-fa5646393d17 req-4429ec78-16c2-4b87-bdb1-ce59c90345f0 tempest-TaggedAttachmentsTest-459403444 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-13779ad6-8343-4698-abf5-a3edd9ad8597', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0e484efb-1640-4a8b-939e-794ea304605e', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:48:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-05945bcb-db8c-4580-83a0-fa5646393d17 req-4429ec78-16c2-4b87-bdb1-ce59c90345f0 tempest-TaggedAttachmentsTest-459403444 None] attachment_update completed successfully.
Jul 06 20:48:19 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-83cc68a9-4b32-4666-97a7-0eeb25c131e7" returned: 0 in 1.191s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-quobyte-83cc68a9-4b32-4666-97a7-0eeb25c131e7" released by "delete_volume" :: held 2.395s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Created reservations ['aa2413aa-877f-476f-8e6d-233e9c582276', '612a6a3a-788c-4cb4-8a03-fe927c033ce7', '30e89d93-3223-4d98-92ce-161765b371b0', 'b5b4ac84-3dd2-49ac-a70f-0c55e77ce3a0'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:19 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 1073741824" returned: 0 in 1.369s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:19 devstack sudo[89941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:48:19 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:19 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634
Jul 06 20:48:19 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "cinder-a3241f8f-d378-4f96-ab09-9f8774228409-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-a3241f8f-d378-4f96-ab09-9f8774228409-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "cinder-quobyte-a3241f8f-d378-4f96-ab09-9f8774228409" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-quobyte-a3241f8f-d378-4f96-ab09-9f8774228409" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94bd5db-e4cf-4a46-b4bc-7f653b224457]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:20 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.864s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:48:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Deleted volume successfully.
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dfa335d0-a9bf-4cf3-9776-7e8b81a914f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-83cc68a9-4b32-4666-97a7-0eeb25c131e7-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:20 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634" returned: 0 in 0.834s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.257s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f231fd7e-ed31-4cbb-b745-01d8006758a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65191642-911c-4d61-b61a-d2d8e2ef3634', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18deaea-10c8-4f3e-821b-47e74c39fc74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:20 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Volume volume-65191642-911c-4d61-b61a-d2d8e2ef3634 (65191642-911c-4d61-b61a-d2d8e2ef3634): created successfully
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c18deaea-10c8-4f3e-821b-47e74c39fc74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:20 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Flow 'volume_create_manager' (76852a46-fb15-40e0-bad0-de6afd4460dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:20 devstack sudo[90263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409
Jul 06 20:48:20 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0a5d829b-66cc-4e79-ba2c-c2c7f1ed0d5e tempest-ServerActionsTestOtherA-496397566 None] Created volume successfully.
Jul 06 20:48:21 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409" returned: 0 in 0.888s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:21 devstack sudo[90270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409
Jul 06 20:48:21 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Flow 'volume_create_manager' (60a5f561-5b20-422f-aed6-4501a6eef9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dadf7d-6572-43e9-9f97-88ce3c6bc42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44dadf7d-6572-43e9-9f97-88ce3c6bc42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1636462966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b7c96c-ee54-459b-8a7d-79616ed38a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afe9db9dc4642d7946adff7ebad433b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:22Z,use_quota=True,user_id='402f5d6e9eb24f879a873cc54b4fbe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e95483-89f2-44ff-818d-d4ac7a1dd881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e95483-89f2-44ff-818d-d4ac7a1dd881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c979bd06-c656-49a0-abb8-7dee1512e346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c979bd06-c656-49a0-abb8-7dee1512e346) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91b7c96c-ee54-459b-8a7d-79616ed38a8b', 'volume_name': 'volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e6e179-3e02-4970-9c75-b35a2f349350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e6e179-3e02-4970-9c75-b35a2f349350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fcb948-e5f7-495c-87e0-97087499467c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:21 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Volume 91b7c96c-ee54-459b-8a7d-79616ed38a8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b', 'volume_size': 1}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1636462966',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91b7c96c-ee54-459b-8a7d-79616ed38a8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1afe9db9dc4642d7946adff7ebad433b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:22Z,use_quota=True,user_id='402f5d6e9eb24f879a873cc54b4fbe38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Creating volume 91b7c96c-ee54-459b-8a7d-79616ed38a8b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:48:21 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:48:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:21 devstack sudo[90272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b 1073741824
Jul 06 20:48:21 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:22 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a3241f8f-d378-4f96-ab09-9f8774228409" returned: 0 in 0.801s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-quobyte-a3241f8f-d378-4f96-ab09-9f8774228409" released by "delete_volume" :: held 1.752s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Created reservations ['8b580121-f360-4e50-8115-1696710e47ec', '25f440c9-dc87-4fd7-8cb3-02e8b8e82489', '9f7400d7-29c9-4aee-8489-6371600bccc6', 'b0d0e9d8-9012-4b3d-94e8-16791234db97'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:22 devstack sudo[90282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:48:22 devstack sudo[90282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:22 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b 1073741824" returned: 0 in 0.981s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:22 devstack sudo[90287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b
Jul 06 20:48:22 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:23 devstack sudo[90282]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.869s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:48:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Deleted volume successfully.
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-52eb57bf-b2e9-4b93-b132-74981c2dc4f9 tempest-ServersNegativeTestJSON-1523827492 None] Lock "cinder-a3241f8f-d378-4f96-ab09-9f8774228409-delete_volume" released by "delete_volume" :: held 2.880s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:23 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b" returned: 0 in 0.924s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.985s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87fcb948-e5f7-495c-87e0-97087499467c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba33fbd2-58b0-4a0f-a528-0ae665365905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Volume volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b (91b7c96c-ee54-459b-8a7d-79616ed38a8b): created successfully
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba33fbd2-58b0-4a0f-a528-0ae665365905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Flow 'volume_create_manager' (60a5f561-5b20-422f-aed6-4501a6eef9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7090eeb3-5914-4ae7-9e04-845306655d8a tempest-AttachVolumeShelveTestJSON-1469557473 None] Created volume successfully.
Jul 06 20:48:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-4b70bdbb-3e62-4426-b852-155433865171 req-5975cdd4-c1d1-43d9-9094-3660255d0400 tempest-TaggedAttachmentsTest-459403444 None] Terminate volume connection completed successfully.
Jul 06 20:48:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-4b70bdbb-3e62-4426-b852-155433865171 req-5975cdd4-c1d1-43d9-9094-3660255d0400 tempest-TaggedAttachmentsTest-459403444 None] Deleting attachment 0e484efb-1640-4a8b-939e-794ea304605e. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:48:35 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=29,cinder:SELECT=24,cinder:INSERT=5,cinder:DELETE=3 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:48:35 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=25,cinder:UPDATE=30,cinder:DELETE=3,cinder:INSERT=7 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:48:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:48:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:37 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:48:37 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:38 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.241s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:48:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:48:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:48:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Flow 'volume_create_manager' (14a44f00-9c9d-4ec3-9040-7c6faecd3810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfee19aa-e17b-455a-ad24-e441043184bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfee19aa-e17b-455a-ad24-e441043184bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-591187247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4301278a-37b8-49ad-b17c-252ae4305aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c918842d4fef45ea9b14dd4889c3fabf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:41Z,use_quota=True,user_id='4e7f02e67edc43898f58a502e87a3b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2cdcfe-1a39-421f-9214-1661a2d6215d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2cdcfe-1a39-421f-9214-1661a2d6215d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1941c19c-c32a-44d4-b9c4-0fdd0d487299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1941c19c-c32a-44d4-b9c4-0fdd0d487299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4301278a-37b8-49ad-b17c-252ae4305aff', 'volume_name': 'volume-4301278a-37b8-49ad-b17c-252ae4305aff', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51276cc3-ec51-4a14-8c5b-b59fb25fc88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51276cc3-ec51-4a14-8c5b-b59fb25fc88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6feb5e2-e49f-4323-b794-f1fe9a15ff24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Volume 4301278a-37b8-49ad-b17c-252ae4305aff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4301278a-37b8-49ad-b17c-252ae4305aff', 'volume_size': 1}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-591187247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4301278a-37b8-49ad-b17c-252ae4305aff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c918842d4fef45ea9b14dd4889c3fabf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:48:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:48:41Z,use_quota=True,user_id='4e7f02e67edc43898f58a502e87a3b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Creating volume 4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:48:41 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:48:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:41 devstack sudo[90512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff 1073741824
Jul 06 20:48:41 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:42 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff 1073741824" returned: 0 in 1.225s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:42 devstack sudo[90522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff
Jul 06 20:48:42 devstack sudo[90522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-82aa1316-eb50-42d1-bbd9-6f6c560c3dbb req-c88b7413-dfbb-4bd4-ad62-188282b445ed tempest-AttachVolumeShelveTestJSON-1469557473 None] No connector for attachment 46b07b44-fc47-4cf3-a7f0-f5c4420a3644; skipping storage backend terminate_connection call. {{(pid=86721) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Jul 06 20:48:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-82aa1316-eb50-42d1-bbd9-6f6c560c3dbb req-c88b7413-dfbb-4bd4-ad62-188282b445ed tempest-AttachVolumeShelveTestJSON-1469557473 None] Deleting attachment 46b07b44-fc47-4cf3-a7f0-f5c4420a3644. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:48:43 devstack sudo[90522]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff" returned: 0 in 0.787s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] <== create_volume: return (2098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:48:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6feb5e2-e49f-4323-b794-f1fe9a15ff24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4301278a-37b8-49ad-b17c-252ae4305aff', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c5866b-2865-4bbf-a74c-096ae6ada20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:48:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Volume volume-4301278a-37b8-49ad-b17c-252ae4305aff (4301278a-37b8-49ad-b17c-252ae4305aff): created successfully
Jul 06 20:48:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08c5866b-2865-4bbf-a74c-096ae6ada20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:48:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Flow 'volume_create_manager' (14a44f00-9c9d-4ec3-9040-7c6faecd3810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:48:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-45080dc2-85ef-496a-83a4-8cf79c6f422b req-b7d9398f-17f4-42ea-b3ee-b664c8d39223 tempest-VolumesSnapshotsTestJSON-1705579666 None] Created volume successfully.
Jul 06 20:48:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Creating offline snapshot b7fcb81d-5a97-461e-bbef-382ac39e353e of volume 4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:48:44 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2381e96e-9656-4ccf-89be-37418d17edfe]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:44 devstack sudo[90529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff
Jul 06 20:48:44 devstack sudo[90529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:45 devstack sudo[90529]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff" returned: 0 in 1.251s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:45 devstack sudo[90534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e 1G
Jul 06 20:48:45 devstack sudo[90534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:46 devstack sudo[90534]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e 1G" returned: 0 in 1.030s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4301278a-37b8-49ad-b17c-252ae4305aff -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:46 devstack sudo[90542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4301278a-37b8-49ad-b17c-252ae4305aff -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e
Jul 06 20:48:46 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Acquiring lock "cinder-13779ad6-8343-4698-abf5-a3edd9ad8597-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Lock "cinder-13779ad6-8343-4698-abf5-a3edd9ad8597-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Acquiring lock "cinder-quobyte-13779ad6-8343-4698-abf5-a3edd9ad8597" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:47 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4301278a-37b8-49ad-b17c-252ae4305aff -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e" returned: 0 in 0.801s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:47 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e is being set with open permissions: ugo+rw
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Lock "cinder-quobyte-13779ad6-8343-4698-abf5-a3edd9ad8597" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:47 devstack sudo[90549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e
Jul 06 20:48:47 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0dbec7-b3fc-44c9-b7a8-5806633a33b5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:47 devstack sudo[90551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597
Jul 06 20:48:47 devstack sudo[90551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:48 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e" returned: 0 in 0.707s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:48 devstack sudo[90554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.info
Jul 06 20:48:48 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:48 devstack sudo[90551]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597" returned: 0 in 0.912s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:48 devstack sudo[90559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597
Jul 06 20:48:48 devstack sudo[90559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:48 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.info" returned: 0 in 0.730s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:48 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.info is being set with open permissions: ugo+rw
Jul 06 20:48:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:49 devstack sudo[90579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.info
Jul 06 20:48:49 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:49 devstack sudo[90559]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-13779ad6-8343-4698-abf5-a3edd9ad8597" returned: 0 in 0.876s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Lock "cinder-quobyte-13779ad6-8343-4698-abf5-a3edd9ad8597" released by "delete_volume" :: held 1.829s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Created reservations ['f39ef02a-b4c2-4df0-9114-0e7b8b05f86e', 'bbd12696-3634-402f-acb2-f6e540926c0c', 'd882afeb-5e8c-40ca-80a1-66be8d7a2e00', 'cad9470e-237f-4b70-b5c4-8410a3068276'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:49 devstack sudo[90582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:48:49 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:49 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.info" returned: 0 in 0.694s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.359s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-c0a5e5bb-fa8f-43c5-ba2c-d8ca2dda28ac req-3605f2e9-43f3-40f9-be31-38ce8014bde6 tempest-VolumesSnapshotsTestJSON-1705579666 None] Create snapshot completed successfully
Jul 06 20:48:50 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:48:50 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Deleted volume successfully.
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f2cacbb9-e9c1-4dc0-bd9b-7cc783bb38e8 tempest-TaggedAttachmentsTest-459403444 None] Lock "cinder-13779ad6-8343-4698-abf5-a3edd9ad8597-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "cinder-b7fcb81d-5a97-461e-bbef-382ac39e353e-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-b7fcb81d-5a97-461e-bbef-382ac39e353e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "cinder-quobyte-4301278a-37b8-49ad-b17c-252ae4305aff" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-quobyte-4301278a-37b8-49ad-b17c-252ae4305aff" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "cinder-quobyte-b7fcb81d-5a97-461e-bbef-382ac39e353e" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-quobyte-b7fcb81d-5a97-461e-bbef-382ac39e353e" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Deleting offline snapshot b7fcb81d-5a97-461e-bbef-382ac39e353e of volume 4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] snapshot_file for this snap is: volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb42a8ec-c4bd-4efd-a03e-63fe26ae79b5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:50 devstack sudo[90586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e
Jul 06 20:48:50 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:51 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e" returned: 0 in 0.895s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4301278a-37b8-49ad-b17c-252ae4305aff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:48:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1976ac6f-8eaf-455e-9a9f-b57481cae9d5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:51 devstack sudo[90592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff
Jul 06 20:48:51 devstack sudo[90592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:52 devstack sudo[90592]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff" returned: 0 in 0.888s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:52 devstack sudo[90599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e
Jul 06 20:48:52 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:53 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e" returned: 0 in 0.891s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:53 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e
Jul 06 20:48:53 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:53 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff.b7fcb81d-5a97-461e-bbef-382ac39e353e" returned: 0 in 0.728s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-quobyte-b7fcb81d-5a97-461e-bbef-382ac39e353e" released by "_delete_snapshot" :: held 3.537s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-quobyte-4301278a-37b8-49ad-b17c-252ae4305aff" released by "delete_snapshot" :: held 3.603s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:54 devstack cinder-volume[86721]: WARNING cinder.quota [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:48:54 devstack cinder-volume[86721]: DEBUG cinder.quota [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Created reservations ['da44757c-0ba7-48ca-ad0f-8af459fb8293', 'f59fd030-61f1-4899-9cbb-9a405c2d4d1e', '2a5deadd-36c0-48e4-921c-b66f3f0683bb', 'c5a74a1f-0add-42bd-85d1-ed41f016e7db'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:48:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Delete snapshot completed successfully.
Jul 06 20:48:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-973f19e6-6ab7-41d0-bdaa-1055b056b55f req-6b547ea9-9bac-4431-9d02-cc60bc07f548 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-b7fcb81d-5a97-461e-bbef-382ac39e353e-delete_snapshot" released by "delete_snapshot" :: held 3.784s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "cinder-4301278a-37b8-49ad-b17c-252ae4305aff-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-4301278a-37b8-49ad-b17c-252ae4305aff-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "cinder-quobyte-4301278a-37b8-49ad-b17c-252ae4305aff" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:48:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-quobyte-4301278a-37b8-49ad-b17c-252ae4305aff" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:48:55 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[081268f6-4cf8-42ed-8fc5-4fd0e2130cdf]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:48:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:55 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff
Jul 06 20:48:55 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:55 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff" returned: 0 in 0.903s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:56 devstack sudo[90615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff
Jul 06 20:48:56 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:56 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4301278a-37b8-49ad-b17c-252ae4305aff" returned: 0 in 0.978s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-quobyte-4301278a-37b8-49ad-b17c-252ae4305aff" released by "delete_volume" :: held 2.014s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG cinder.quota [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Created reservations ['8cde3edf-c68a-4a39-9d74-63311fd7221f', '3630ee78-8a20-4d5b-aea9-cd1674da20c1', 'bdb3b6b5-75ac-4025-bdc9-a267eb7cc0f5', '85b648d1-4fe5-4cca-94eb-1fef9d14df86'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:48:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:48:57 devstack sudo[90647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:48:57 devstack sudo[90647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:48:58 devstack sudo[90647]: pam_unix(sudo:session): session closed for user root
Jul 06 20:48:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.120s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:48:58 devstack cinder-volume[86721]: DEBUG cinder.manager [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:48:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Deleted volume successfully.
Jul 06 20:48:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-4d4885cc-47e4-4f5a-aa1a-655bb50939d9 req-41153011-9e2b-4dc2-9b13-872f9fff64c8 tempest-VolumesSnapshotsTestJSON-1705579666 None] Lock "cinder-4301278a-37b8-49ad-b17c-252ae4305aff-delete_volume" released by "delete_volume" :: held 3.564s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-51665bdb-b835-4bca-80cd-2ac884a47388 tempest-GroupSnapshotsV319Test-116914680 None] Group tempest-GroupSnapshotsV319Test-Group-1228046808: creating
Jul 06 20:49:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-51665bdb-b835-4bca-80cd-2ac884a47388 tempest-GroupSnapshotsV319Test-116914680 None] Group tempest-GroupSnapshotsV319Test-Group-1228046808: created successfully
Jul 06 20:49:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-51665bdb-b835-4bca-80cd-2ac884a47388 tempest-GroupSnapshotsV319Test-116914680 None] Create group completed successfully.
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Flow 'volume_create_manager' (53456ba2-2244-4ce2-afe0-5bdf3551043b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849c4450-b791-40d9-8906-6668308fedc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849c4450-b791-40d9-8906-6668308fedc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-548721397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00aebc5-3879-4f7f-ad04-04da560755d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f1ce911fbedd4d8a936a2c2d8efc5576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:04Z,use_quota=True,user_id='761956b13ab94b12b9282a4bfdb7b92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a9c73f-929f-43dc-bba9-f41cf6e1641b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53a9c73f-929f-43dc-bba9-f41cf6e1641b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debc9ab8-40a7-413e-b675-a424b670d1c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debc9ab8-40a7-413e-b675-a424b670d1c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00aebc5-3879-4f7f-ad04-04da560755d5', 'volume_name': 'volume-c00aebc5-3879-4f7f-ad04-04da560755d5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82df152f-e42e-4de6-ae0f-7f90af844df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82df152f-e42e-4de6-ae0f-7f90af844df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0481dd53-b653-4f41-a879-5dd444b6e265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:04 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Volume c00aebc5-3879-4f7f-ad04-04da560755d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00aebc5-3879-4f7f-ad04-04da560755d5', 'volume_size': 1}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-548721397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00aebc5-3879-4f7f-ad04-04da560755d5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f1ce911fbedd4d8a936a2c2d8efc5576',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:04Z,use_quota=True,user_id='761956b13ab94b12b9282a4bfdb7b92b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Creating volume c00aebc5-3879-4f7f-ad04-04da560755d5 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:49:04 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:49:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:04 devstack sudo[90769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5 1073741824
Jul 06 20:49:04 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:05 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5 1073741824" returned: 0 in 1.329s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:05 devstack sudo[90780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5
Jul 06 20:49:05 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:05 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:49:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Flow 'volume_create_manager' (ce26aacf-1230-406c-bca7-dfa5e2bd5844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5172c5-0a73-4b18-9c23-830664080000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce5172c5-0a73-4b18-9c23-830664080000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327150060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d03ee11-42a9-4049-8886-2109261539c9,host='devstack@QuobyteHD#QuobyteHD',id=88d059bb-2f73-49b2-be35-efcd70002be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf63a5485d647bdb7435bc5664e2a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:06Z,use_quota=True,user_id='121d05f4dd704a1dbbd522bf0fdd520d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7979a38f-db97-49bd-9a98-24a1549de056),volume_type_id=7979a38f-db97-49bd-9a98-24a1549de056)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c106543-c74f-4b7d-bb33-51cbd9bf3c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c106543-c74f-4b7d-bb33-51cbd9bf3c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2368db-f834-425f-80d6-f18a0686ba18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa2368db-f834-425f-80d6-f18a0686ba18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d059bb-2f73-49b2-be35-efcd70002be5', 'volume_name': 'volume-88d059bb-2f73-49b2-be35-efcd70002be5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097f96c8-a11b-4336-8d98-942b4b73284c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097f96c8-a11b-4336-8d98-942b4b73284c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13603c0e-7716-482a-9d1e-4eaa6e193a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:06 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Volume 88d059bb-2f73-49b2-be35-efcd70002be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d059bb-2f73-49b2-be35-efcd70002be5', 'volume_size': 1}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-40261f8b-1f4b-44d7-86a0-2c52885cab63 req-31659cdd-3b03-475b-9c96-2750d5eebdb6 tempest-ServerActionsTestOtherA-496397566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:06 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5" returned: 0 in 0.898s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] <== create_volume: return (2343ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.346s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.464s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=4d03ee11-42a9-4049-8886-2109261539c9,created_at=2026-07-06T18:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-327150060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=4d03ee11-42a9-4049-8886-2109261539c9,host='devstack@QuobyteHD#QuobyteHD',id=88d059bb-2f73-49b2-be35-efcd70002be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bf63a5485d647bdb7435bc5664e2a06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:06Z,use_quota=True,user_id='121d05f4dd704a1dbbd522bf0fdd520d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7979a38f-db97-49bd-9a98-24a1549de056),volume_type_id=7979a38f-db97-49bd-9a98-24a1549de056)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Creating volume 88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:49:06 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:06 devstack sudo[90791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 1073741824
Jul 06 20:49:06 devstack sudo[90791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0481dd53-b653-4f41-a879-5dd444b6e265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00aebc5-3879-4f7f-ad04-04da560755d5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0759768a-36b5-49bf-a943-f0fa5dbcd19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:06 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Volume volume-c00aebc5-3879-4f7f-ad04-04da560755d5 (c00aebc5-3879-4f7f-ad04-04da560755d5): created successfully
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0759768a-36b5-49bf-a943-f0fa5dbcd19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Flow 'volume_create_manager' (53456ba2-2244-4ce2-afe0-5bdf3551043b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:06 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-74082c74-4d64-4179-ba9b-9392f1b03e87 req-bcddfa3d-6e63-4790-979f-e3872926989e tempest-VolumesGetTestJSON-897484126 None] Created volume successfully.
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Acquiring lock "cinder-c00aebc5-3879-4f7f-ad04-04da560755d5-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Lock "cinder-c00aebc5-3879-4f7f-ad04-04da560755d5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Acquiring lock "cinder-quobyte-c00aebc5-3879-4f7f-ad04-04da560755d5" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Lock "cinder-quobyte-c00aebc5-3879-4f7f-ad04-04da560755d5" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[60717295-098d-45c7-be88-1608a34f3ad1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:07 devstack sudo[90795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5
Jul 06 20:49:07 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:07 devstack sudo[90791]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 1073741824" returned: 0 in 0.972s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:07 devstack sudo[90801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5
Jul 06 20:49:07 devstack sudo[90801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:07 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5" returned: 0 in 0.902s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:08 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5
Jul 06 20:49:08 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:08 devstack sudo[90801]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5" returned: 0 in 0.737s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-40261f8b-1f4b-44d7-86a0-2c52885cab63 req-31659cdd-3b03-475b-9c96-2750d5eebdb6 tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.183s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13603c0e-7716-482a-9d1e-4eaa6e193a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d059bb-2f73-49b2-be35-efcd70002be5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e74381-5fa1-492d-a3a1-3ae19884f776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f67335f-6215-4088-bd5c-88f37f9ab3b4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-40261f8b-1f4b-44d7-86a0-2c52885cab63 req-31659cdd-3b03-475b-9c96-2750d5eebdb6 tempest-ServerActionsTestOtherA-496397566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:08 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Volume volume-88d059bb-2f73-49b2-be35-efcd70002be5 (88d059bb-2f73-49b2-be35-efcd70002be5): created successfully
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e74381-5fa1-492d-a3a1-3ae19884f776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Flow 'volume_create_manager' (ce26aacf-1230-406c-bca7-dfa5e2bd5844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9f8e58a5-4444-4b3d-8015-4028bfe31c53 tempest-GroupSnapshotsV319Test-116914680 None] Created volume successfully.
Jul 06 20:49:08 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634
Jul 06 20:49:08 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:08 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c00aebc5-3879-4f7f-ad04-04da560755d5" returned: 0 in 0.889s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Lock "cinder-quobyte-c00aebc5-3879-4f7f-ad04-04da560755d5" released by "delete_volume" :: held 1.866s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:08 devstack cinder-volume[86721]: DEBUG cinder.quota [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Created reservations ['a4dfd0dd-f6b1-48db-9978-e8b3a8569655', '75e4e325-d011-4d7c-895b-b76bba8ad26c', '4c1d34db-8014-4851-86d6-9741dcd112b6', 'a500cd5b-595e-45b2-9104-7a75d11c99d7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:09 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:49:09 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:09 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-40261f8b-1f4b-44d7-86a0-2c52885cab63 req-31659cdd-3b03-475b-9c96-2750d5eebdb6 tempest-ServerActionsTestOtherA-496397566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634" returned: 0 in 0.938s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-40261f8b-1f4b-44d7-86a0-2c52885cab63 req-31659cdd-3b03-475b-9c96-2750d5eebdb6 tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-40261f8b-1f4b-44d7-86a0-2c52885cab63 req-31659cdd-3b03-475b-9c96-2750d5eebdb6 tempest-ServerActionsTestOtherA-496397566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-65191642-911c-4d61-b61a-d2d8e2ef3634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '479bfc93-db2b-44e7-999f-5ce36ffc9f6c', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:49:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-40261f8b-1f4b-44d7-86a0-2c52885cab63 req-31659cdd-3b03-475b-9c96-2750d5eebdb6 tempest-ServerActionsTestOtherA-496397566 None] attachment_update completed successfully.
Jul 06 20:49:09 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG cinder.manager [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:49:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Deleted volume successfully.
Jul 06 20:49:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-036c61f9-7c3c-4aa7-b05e-d0319c808da1 req-8bd5a6bb-9f14-4df4-b7ab-b0123bb46cf3 tempest-VolumesGetTestJSON-897484126 None] Lock "cinder-c00aebc5-3879-4f7f-ad04-04da560755d5-delete_volume" released by "delete_volume" :: held 2.990s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] GroupSnapshot 4b40196e-9178-4b01-b724-35fca537b835: creating.
Jul 06 20:49:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Group snapshot 4b40196e-9178-4b01-b724-35fca537b835: creating. {{(pid=86721) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 20:49:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Creating offline snapshot f0cf792e-7167-48a3-b2ff-8216f08378e3 of volume 88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:49:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[563d4da8-481a-4726-8fd2-110586b14e2c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:10 devstack sudo[90909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5
Jul 06 20:49:10 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:11 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5" returned: 0 in 0.994s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:11 devstack sudo[91230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 1G
Jul 06 20:49:11 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:12 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 1G" returned: 0 in 0.982s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88d059bb-2f73-49b2-be35-efcd70002be5 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:12 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88d059bb-2f73-49b2-be35-efcd70002be5 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3
Jul 06 20:49:12 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:12 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88d059bb-2f73-49b2-be35-efcd70002be5 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3" returned: 0 in 0.734s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:12 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:49:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:12 devstack sudo[91241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3
Jul 06 20:49:12 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:13 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3" returned: 0 in 0.785s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:13 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.info
Jul 06 20:49:13 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:14 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.info" returned: 0 in 0.859s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:14 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:49:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:14 devstack sudo[91247]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.info
Jul 06 20:49:14 devstack sudo[91247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:15 devstack sudo[91247]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.info" returned: 0 in 0.901s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.397s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:15 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-885094d9-b403-4f01-bca0-8b8b96b3f5ac tempest-GroupSnapshotsV319Test-116914680 None] group_snapshot 4b40196e-9178-4b01-b724-35fca537b835: created successfully
Jul 06 20:49:17 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] group_snapshot 4b40196e-9178-4b01-b724-35fca537b835: deleting
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] group_snapshot 4b40196e-9178-4b01-b724-35fca537b835: deleting {{(pid=86721) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Acquiring lock "cinder-quobyte-88d059bb-2f73-49b2-be35-efcd70002be5" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Lock "cinder-quobyte-88d059bb-2f73-49b2-be35-efcd70002be5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Acquiring lock "cinder-quobyte-f0cf792e-7167-48a3-b2ff-8216f08378e3" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Lock "cinder-quobyte-f0cf792e-7167-48a3-b2ff-8216f08378e3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Deleting offline snapshot f0cf792e-7167-48a3-b2ff-8216f08378e3 of volume 88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] snapshot_file for this snap is: volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b974b0-710e-49f9-ae3f-5606378c5bc2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:17 devstack sudo[91256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3
Jul 06 20:49:17 devstack sudo[91256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:17 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-6fe3a2b6-dc08-477d-9809-85266095db16 tempest-ServerActionsTestOtherA-496397566 None] Terminate volume connection completed successfully.
Jul 06 20:49:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-6fe3a2b6-dc08-477d-9809-85266095db16 tempest-ServerActionsTestOtherA-496397566 None] Deleting attachment 479bfc93-db2b-44e7-999f-5ce36ffc9f6c. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:49:18 devstack sudo[91256]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3" returned: 0 in 0.912s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88d059bb-2f73-49b2-be35-efcd70002be5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec915d35-c85f-4a61-a157-20717e4fb226]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:18 devstack sudo[91293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5
Jul 06 20:49:18 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:19 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5" returned: 0 in 0.802s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:19 devstack sudo[91298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3
Jul 06 20:49:19 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:20 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3" returned: 0 in 1.131s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:20 devstack sudo[91331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3
Jul 06 20:49:20 devstack sudo[91331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-f95a1a6f-ab1f-4e7a-90f8-2bebe7bf2c4a tempest-ServerActionsTestOtherA-496397566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-f95a1a6f-ab1f-4e7a-90f8-2bebe7bf2c4a tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a84b3ac-7886-4673-b866-1b3c34f45a38]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-f95a1a6f-ab1f-4e7a-90f8-2bebe7bf2c4a tempest-ServerActionsTestOtherA-496397566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:20 devstack sudo[91341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634
Jul 06 20:49:20 devstack sudo[91341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:20 devstack sudo[91331]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5.f0cf792e-7167-48a3-b2ff-8216f08378e3" returned: 0 in 0.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Lock "cinder-quobyte-f0cf792e-7167-48a3-b2ff-8216f08378e3" released by "_delete_snapshot" :: held 3.707s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Lock "cinder-quobyte-88d059bb-2f73-49b2-be35-efcd70002be5" released by "delete_snapshot" :: held 3.734s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:20 devstack cinder-volume[86721]: WARNING cinder.quota [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-536261971 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-536261971, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:49:20 devstack cinder-volume[86721]: WARNING cinder.quota [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-536261971 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-536261971, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] Created reservations ['7221f312-da22-4d4d-b00b-427338fb448c', 'f70046c8-8f63-43f9-a1e2-0a9806ebc65f', '200296be-4d1c-4b11-a31a-de66eff54f24', '87056f73-3f56-4527-adea-69c6e35f0041'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ad1dc76e-fdf5-4a74-b6a8-c673bbb32aa3 tempest-GroupSnapshotsV319Test-116914680 None] group_snapshot 4b40196e-9178-4b01-b724-35fca537b835: deleted successfully
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Flow 'volume_create_manager' (4379a636-2e67-423c-b21e-bf29668403d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8800331-4468-4e1b-8244-6c8254d5165c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8800331-4468-4e1b-8244-6c8254d5165c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-800505921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d93e476-4df0-45e3-9e9d-e7850571135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08d566c0f85945a7a9a49c4ba9197da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:21Z,use_quota=True,user_id='e57348b0733444e9be4af8b17683554f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0fbb3a-7daa-4e83-bb67-115693edbd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0fbb3a-7daa-4e83-bb67-115693edbd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e422c24-c826-4e97-a3f3-f0687c90a524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e422c24-c826-4e97-a3f3-f0687c90a524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d93e476-4df0-45e3-9e9d-e7850571135a', 'volume_name': 'volume-1d93e476-4df0-45e3-9e9d-e7850571135a', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c924ab4-6190-40dc-aaa1-62e29026c281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c924ab4-6190-40dc-aaa1-62e29026c281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a5fb17-e16c-43a9-816b-83156d3b902d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:21 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Volume 1d93e476-4df0-45e3-9e9d-e7850571135a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d93e476-4df0-45e3-9e9d-e7850571135a', 'volume_size': 1}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:21 devstack sudo[91341]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-f95a1a6f-ab1f-4e7a-90f8-2bebe7bf2c4a tempest-ServerActionsTestOtherA-496397566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634" returned: 0 in 0.901s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-f95a1a6f-ab1f-4e7a-90f8-2bebe7bf2c4a tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.918s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.066s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-800505921',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d93e476-4df0-45e3-9e9d-e7850571135a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08d566c0f85945a7a9a49c4ba9197da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:21Z,use_quota=True,user_id='e57348b0733444e9be4af8b17683554f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Creating volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:49:21 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:21 devstack sudo[91348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a 1073741824
Jul 06 20:49:21 devstack sudo[91348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-f95a1a6f-ab1f-4e7a-90f8-2bebe7bf2c4a tempest-ServerActionsTestOtherA-496397566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-65191642-911c-4d61-b61a-d2d8e2ef3634', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f6e6e2eb-a0f0-483e-baa3-cadb73b0c531', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Acquiring lock "cinder-quobyte-88d059bb-2f73-49b2-be35-efcd70002be5" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Lock "cinder-quobyte-88d059bb-2f73-49b2-be35-efcd70002be5" acquired by "delete_volume" :: waited 0.034s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad0ea81-df8e-4e2c-b781-e5abeb56cdc8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-79055a5b-3d47-4782-ac9e-d064824e9238 req-f95a1a6f-ab1f-4e7a-90f8-2bebe7bf2c4a tempest-ServerActionsTestOtherA-496397566 None] attachment_update completed successfully.
Jul 06 20:49:21 devstack sudo[91351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5
Jul 06 20:49:21 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:22 devstack sudo[91348]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a 1073741824" returned: 0 in 0.885s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:22 devstack sudo[91360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a
Jul 06 20:49:22 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:22 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:22 devstack sudo[91362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5
Jul 06 20:49:22 devstack sudo[91362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:23 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a" returned: 0 in 0.732s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93a5fb17-e16c-43a9-816b-83156d3b902d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d93e476-4df0-45e3-9e9d-e7850571135a', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f23b81-39e2-4fbb-abd8-548daef7facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Volume volume-1d93e476-4df0-45e3-9e9d-e7850571135a (1d93e476-4df0-45e3-9e9d-e7850571135a): created successfully
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95f23b81-39e2-4fbb-abd8-548daef7facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Flow 'volume_create_manager' (4379a636-2e67-423c-b21e-bf29668403d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8102637e-5b64-4ee4-84cd-42a9147f4e67 tempest-SnapshotsActionsTest-679787021 None] Created volume successfully.
Jul 06 20:49:23 devstack sudo[91362]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88d059bb-2f73-49b2-be35-efcd70002be5" returned: 0 in 0.758s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Lock "cinder-quobyte-88d059bb-2f73-49b2-be35-efcd70002be5" released by "delete_volume" :: held 1.700s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Created reservations ['9349f33a-1fa1-4beb-9d46-020cbae088a9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:23 devstack cinder-volume[86721]: WARNING cinder.quota [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-536261971 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-536261971, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Created reservations ['06322590-d0ee-4cd0-85b0-773a87c59cb6', 'eb536438-a181-49ae-8fa4-7b043af03874', '854649dd-5868-4f15-b131-57acc97d9640', 'e403b76f-6a7e-440b-9152-a2019f89e804'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:23 devstack sudo[91366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:49:23 devstack sudo[91366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Creating offline snapshot 0e718882-ac1f-4eed-9280-03430c6b3e6f of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[73995eaf-6c33-4f4d-adad-21176cf925be]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:23 devstack sudo[91369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a
Jul 06 20:49:23 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:24 devstack sudo[91366]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.958s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:24 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:49:24 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c4b5df23-f3f9-4f79-aa02-71d76dbbee19 tempest-GroupSnapshotsV319Test-116914680 None] Delete group completed successfully.
Jul 06 20:49:24 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a" returned: 0 in 1.002s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:24 devstack sudo[91393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f 1G
Jul 06 20:49:24 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:25 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f 1G" returned: 0 in 0.961s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:25 devstack sudo[91468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:25 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:26 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.206s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:26 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f is being set with open permissions: ugo+rw
Jul 06 20:49:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:26 devstack sudo[91495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:26 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:27 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 0.799s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:27 devstack sudo[91829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.info
Jul 06 20:49:27 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:28 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.info" returned: 0 in 0.966s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:28 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.info is being set with open permissions: ugo+rw
Jul 06 20:49:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:28 devstack sudo[91857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.info
Jul 06 20:49:28 devstack sudo[91857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:29 devstack sudo[91857]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.info" returned: 0 in 1.107s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.231s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:29 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ce4ff1c6-b9cf-4936-9fff-8a928d56e8ca tempest-SnapshotsActionsTest-679787021 None] Create snapshot completed successfully
Jul 06 20:49:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a8d0e59f-7c21-4d3a-ab34-c5374764fc90 tempest-GroupsTest-205502653 None] Group tempest-Group1-453742793: creating
Jul 06 20:49:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a8d0e59f-7c21-4d3a-ab34-c5374764fc90 tempest-GroupsTest-205502653 None] Group tempest-Group1-453742793: created successfully
Jul 06 20:49:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a8d0e59f-7c21-4d3a-ab34-c5374764fc90 tempest-GroupsTest-205502653 None] Create group completed successfully.
Jul 06 20:49:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Creating offline snapshot 71b2ee54-9cf7-448e-98b4-7114dbc1b54a of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:49:31 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b766181-0199-48c0-9d61-9606dbccdee6]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:32 devstack sudo[91867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:32 devstack sudo[91867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-aafe6dcf-513c-4482-ba49-7ea42d4b0ca5 tempest-GroupsTest-205502653 None] Group tempest-Group2-779870799: creating
Jul 06 20:49:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-aafe6dcf-513c-4482-ba49-7ea42d4b0ca5 tempest-GroupsTest-205502653 None] Group tempest-Group2-779870799: created successfully
Jul 06 20:49:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-aafe6dcf-513c-4482-ba49-7ea42d4b0ca5 tempest-GroupsTest-205502653 None] Create group completed successfully.
Jul 06 20:49:32 devstack sudo[91867]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 0.860s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:32 devstack sudo[91877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a 1G
Jul 06 20:49:32 devstack sudo[91877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:33 devstack sudo[91877]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a 1G" returned: 0 in 0.908s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:33 devstack sudo[91882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a
Jul 06 20:49:33 devstack sudo[91882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:49:34 devstack sudo[91882]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Flow 'volume_create_manager' (0bf71f3b-5f53-453a-920c-93aff5af588a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a72c851-f6c5-4fd8-9a8c-e413623a2633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a" returned: 0 in 0.832s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:34 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a is being set with open permissions: ugo+rw
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a72c851-f6c5-4fd8-9a8c-e413623a2633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941637037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9d1b8b73-5424-49a5-898d-f34f3ce79410,host='devstack@QuobyteHD#QuobyteHD',id=c3f61cb4-6a18-4b95-903c-855343ae097b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853b16327f0e4b9fbfaa7e4ba8569a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:34Z,use_quota=True,user_id='a9757c9d13514df98aeab81e750d016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8869c965-8358-402b-b14a-40b329f5a08e),volume_type_id=8869c965-8358-402b-b14a-40b329f5a08e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:34 devstack sudo[91889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a
Jul 06 20:49:34 devstack sudo[91889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4936cb5-78e8-494c-b307-156aef29871d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4936cb5-78e8-494c-b307-156aef29871d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c4a1fe-5bef-4965-9cbe-5eb67a9452b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c4a1fe-5bef-4965-9cbe-5eb67a9452b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3f61cb4-6a18-4b95-903c-855343ae097b', 'volume_name': 'volume-c3f61cb4-6a18-4b95-903c-855343ae097b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82837d1-5d26-4339-ac4e-2225608a1320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82837d1-5d26-4339-ac4e-2225608a1320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab83b82-567b-4d18-8456-2edb7f076fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:34 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Volume c3f61cb4-6a18-4b95-903c-855343ae097b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3f61cb4-6a18-4b95-903c-855343ae097b', 'volume_size': 1}
Jul 06 20:49:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:35 devstack sudo[91889]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a" returned: 0 in 0.760s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.473s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.746s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9d1b8b73-5424-49a5-898d-f34f3ce79410,created_at=2026-07-06T18:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1941637037',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9d1b8b73-5424-49a5-898d-f34f3ce79410,host='devstack@QuobyteHD#QuobyteHD',id=c3f61cb4-6a18-4b95-903c-855343ae097b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853b16327f0e4b9fbfaa7e4ba8569a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:34Z,use_quota=True,user_id='a9757c9d13514df98aeab81e750d016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8869c965-8358-402b-b14a-40b329f5a08e),volume_type_id=8869c965-8358-402b-b14a-40b329f5a08e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Creating volume c3f61cb4-6a18-4b95-903c-855343ae097b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:49:35 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:35 devstack sudo[91892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b 1073741824
Jul 06 20:49:35 devstack sudo[91892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fba474ce-b317-428d-8e0b-12974a549a36 tempest-SnapshotsActionsTest-679787021 None] Create snapshot completed successfully
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Acquiring lock "cinder-91b7c96c-ee54-459b-8a7d-79616ed38a8b-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "cinder-91b7c96c-ee54-459b-8a7d-79616ed38a8b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=73,cinder:SELECT=84,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=73,cinder:UPDATE=71,cinder:DELETE=5,cinder:INSERT=16 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Acquiring lock "cinder-quobyte-91b7c96c-ee54-459b-8a7d-79616ed38a8b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "cinder-quobyte-91b7c96c-ee54-459b-8a7d-79616ed38a8b" acquired by "delete_volume" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[afca52c3-15c8-4905-bd5c-6aea3c693f3c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:36 devstack sudo[91894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b
Jul 06 20:49:36 devstack sudo[91894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-71b2ee54-9cf7-448e-98b4-7114dbc1b54a-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-71b2ee54-9cf7-448e-98b4-7114dbc1b54a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-71b2ee54-9cf7-448e-98b4-7114dbc1b54a" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-71b2ee54-9cf7-448e-98b4-7114dbc1b54a" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Deleting offline snapshot 71b2ee54-9cf7-448e-98b4-7114dbc1b54a of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] snapshot_file for this snap is: volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce719c9b-628c-4c20-818f-a5782f868dcb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:36 devstack sudo[91892]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b 1073741824" returned: 0 in 1.119s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:36 devstack sudo[91900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a
Jul 06 20:49:36 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:36 devstack sudo[91902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b
Jul 06 20:49:36 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:37 devstack sudo[91894]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b" returned: 0 in 1.082s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:37 devstack sudo[91907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b
Jul 06 20:49:37 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:37 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b" returned: 0 in 0.737s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] <== create_volume: return (1907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab83b82-567b-4d18-8456-2edb7f076fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3f61cb4-6a18-4b95-903c-855343ae097b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f6c7ce-baf1-41a5-8055-a7be58e59c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:37 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Volume volume-c3f61cb4-6a18-4b95-903c-855343ae097b (c3f61cb4-6a18-4b95-903c-855343ae097b): created successfully
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f6c7ce-baf1-41a5-8055-a7be58e59c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Flow 'volume_create_manager' (0bf71f3b-5f53-453a-920c-93aff5af588a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-80fea1e7-55d3-40de-99b4-321732a713a4 tempest-GroupsTest-205502653 None] Created volume successfully.
Jul 06 20:49:37 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a" returned: 0 in 1.116s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c468c1-dc78-4bf6-8a81-62724c628afc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:37 devstack sudo[91914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:37 devstack sudo[91914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:37 devstack sudo[91917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:49:37 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:37 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-91b7c96c-ee54-459b-8a7d-79616ed38a8b" returned: 0 in 0.752s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "cinder-quobyte-91b7c96c-ee54-459b-8a7d-79616ed38a8b" released by "delete_volume" :: held 1.881s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Created reservations ['bf34debf-81f7-4ee7-a8a3-f6ba2785970e', '2ac78f71-3099-4346-9cf7-dde4a33d8c56', '129e30af-ee22-40b7-8ed5-5d12afc70cb0', '0a451a73-fcc0-4e62-b848-25c0a3c26e12'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:37 devstack sudo[91919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:49:37 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:38 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.994s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:49:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:49:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:49:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:49:39 devstack sudo[91914]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.519s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:39 devstack sudo[91928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a
Jul 06 20:49:39 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Acquiring lock "cinder-quobyte-c3f61cb4-6a18-4b95-903c-855343ae097b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Lock "cinder-quobyte-c3f61cb4-6a18-4b95-903c-855343ae097b" acquired by "delete_volume" :: waited 0.073s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1aec9d-928c-4430-a106-945a36cdd87b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:39 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.514s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:49:39 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Deleted volume successfully.
Jul 06 20:49:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-19aa3d56-355f-4bd3-8c2b-df0bcee739fd tempest-AttachVolumeShelveTestJSON-1469557473 None] Lock "cinder-91b7c96c-ee54-459b-8a7d-79616ed38a8b-delete_volume" released by "delete_volume" :: held 3.686s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:39 devstack sudo[91930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b
Jul 06 20:49:39 devstack sudo[91930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:40 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a" returned: 0 in 1.077s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:40 devstack sudo[91936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a
Jul 06 20:49:40 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:40 devstack sudo[91930]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b" returned: 0 in 1.048s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:40 devstack sudo[91942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b
Jul 06 20:49:40 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:41 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.71b2ee54-9cf7-448e-98b4-7114dbc1b54a" returned: 0 in 0.891s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-71b2ee54-9cf7-448e-98b4-7114dbc1b54a" released by "_delete_snapshot" :: held 4.712s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" released by "delete_snapshot" :: held 4.743s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Created reservations ['5ba39703-8bc4-428d-87f9-aceffcdc9720', '6961fe40-da58-4d6f-8f00-fe1b4dfb0577', '57d8786d-65e6-4a96-aae4-f4f8dd0fd143', 'fe22d4c2-4fab-4531-a8e4-015a938a0360'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Delete snapshot completed successfully.
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0e7ed5e9-571f-49d3-a5d1-179991d5e4c7 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-71b2ee54-9cf7-448e-98b4-7114dbc1b54a-delete_snapshot" released by "delete_snapshot" :: held 4.940s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:41 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c3f61cb4-6a18-4b95-903c-855343ae097b" returned: 0 in 0.902s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Lock "cinder-quobyte-c3f61cb4-6a18-4b95-903c-855343ae097b" released by "delete_volume" :: held 2.053s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Created reservations ['a0bd2f34-2ba3-47bd-9420-860ad1870d63'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:41 devstack cinder-volume[86721]: WARNING cinder.quota [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1547950618 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1547950618, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:49:41 devstack cinder-volume[86721]: WARNING cinder.quota [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1547950618 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1547950618, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Created reservations ['f33f0dc5-c124-4756-8ba4-a4d660b2d7ca', 'cc801521-ed83-4124-8c98-95f7a0a09c0e', '756123d8-723e-4535-9b46-f396aa0c27a8', '65521c25-f131-4699-84dd-8f70372bd2c6'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:41 devstack sudo[91948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:49:41 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Creating offline snapshot a07f9ade-3da2-46ee-8a9e-f8a2f923a4af of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91b9458-034a-49a8-a002-6fbd7af43c14]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Created reservations ['53aa7001-a148-4f84-878f-38535677bfb2'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:42 devstack sudo[91974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:42 devstack sudo[91974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:42 devstack sudo[91976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:49:42 devstack sudo[91976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:42 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.111s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:42 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:49:42 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5261ebaf-cc0e-44a1-9084-246a4249416e tempest-GroupsTest-205502653 None] Delete group completed successfully.
Jul 06 20:49:43 devstack sudo[91976]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.826s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:43 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:49:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0fc371e4-b25b-4c8e-8754-76bd723bb7b0 tempest-GroupsTest-205502653 None] Delete group completed successfully.
Jul 06 20:49:43 devstack sudo[91974]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.114s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:43 devstack sudo[91984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af 1G
Jul 06 20:49:43 devstack sudo[91984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5bba6454-8790-458c-8368-e9ca225a4503 tempest-GroupsTest-205502653 None] Group tempest-GroupsTest-Group-685533029: creating
Jul 06 20:49:44 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5bba6454-8790-458c-8368-e9ca225a4503 tempest-GroupsTest-205502653 None] Group tempest-GroupsTest-Group-685533029: created successfully
Jul 06 20:49:44 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5bba6454-8790-458c-8368-e9ca225a4503 tempest-GroupsTest-205502653 None] Create group completed successfully.
Jul 06 20:49:44 devstack sudo[91984]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af 1G" returned: 0 in 0.921s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:44 devstack sudo[91990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af
Jul 06 20:49:44 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:45 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" returned: 0 in 0.717s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:45 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af is being set with open permissions: ugo+rw
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:45 devstack sudo[91995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af
Jul 06 20:49:45 devstack sudo[91995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:49:45 devstack sudo[91995]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Flow 'volume_create_manager' (bf94c18b-6fcb-4713-bf8d-1a0b6645840e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b292a87c-448a-40ad-a906-0c16ee76080b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" returned: 0 in 0.722s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b292a87c-448a-40ad-a906-0c16ee76080b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779551841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e67ed5c2-6e02-4601-874e-652e50386ffa,host='devstack@QuobyteHD#QuobyteHD',id=4a908638-b8da-4086-8aee-ca976d8f99ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853b16327f0e4b9fbfaa7e4ba8569a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:46Z,use_quota=True,user_id='a9757c9d13514df98aeab81e750d016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35098f74-6719-4dd3-8847-404498422e03),volume_type_id=35098f74-6719-4dd3-8847-404498422e03)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9053114d-b1c9-48a0-a769-415ae0edaebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9053114d-b1c9-48a0-a769-415ae0edaebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf062f8c-9d11-433b-ba46-45970cd44cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf062f8c-9d11-433b-ba46-45970cd44cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a908638-b8da-4086-8aee-ca976d8f99ef', 'volume_name': 'volume-4a908638-b8da-4086-8aee-ca976d8f99ef', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8665d800-5b27-4c04-8630-9ea227aed110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8665d800-5b27-4c04-8630-9ea227aed110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be768509-085a-4a7a-b816-a744c7928c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Volume 4a908638-b8da-4086-8aee-ca976d8f99ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a908638-b8da-4086-8aee-ca976d8f99ef', 'volume_size': 1}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.648s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e67ed5c2-6e02-4601-874e-652e50386ffa,created_at=2026-07-06T18:49:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-779551841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e67ed5c2-6e02-4601-874e-652e50386ffa,host='devstack@QuobyteHD#QuobyteHD',id=4a908638-b8da-4086-8aee-ca976d8f99ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853b16327f0e4b9fbfaa7e4ba8569a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:46Z,use_quota=True,user_id='a9757c9d13514df98aeab81e750d016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35098f74-6719-4dd3-8847-404498422e03),volume_type_id=35098f74-6719-4dd3-8847-404498422e03)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Creating volume 4a908638-b8da-4086-8aee-ca976d8f99ef {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:49:45 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:49:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:45 devstack sudo[92022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef 1073741824
Jul 06 20:49:45 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c4403bf3-3e69-4f47-8d75-0ab24df9e1e6 tempest-SnapshotsActionsTest-679787021 None] Create snapshot completed successfully
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-a07f9ade-3da2-46ee-8a9e-f8a2f923a4af-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-a07f9ade-3da2-46ee-8a9e-f8a2f923a4af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Deleting offline snapshot a07f9ade-3da2-46ee-8a9e-f8a2f923a4af of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] snapshot_file for this snap is: volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9254075-8dd7-4063-8b4f-b1f9a3ca0e00]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:46 devstack sudo[92029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af
Jul 06 20:49:46 devstack sudo[92029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:46 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef 1073741824" returned: 0 in 1.078s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:46 devstack sudo[92031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef
Jul 06 20:49:46 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:47 devstack sudo[92029]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" returned: 0 in 0.934s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b253fd-f902-4333-b452-be5c9a8a8f1f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:47 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef" returned: 0 in 0.719s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be768509-085a-4a7a-b816-a744c7928c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a908638-b8da-4086-8aee-ca976d8f99ef', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b94674-037b-4976-9ea7-79d9006b2b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:47 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Volume volume-4a908638-b8da-4086-8aee-ca976d8f99ef (4a908638-b8da-4086-8aee-ca976d8f99ef): created successfully
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90b94674-037b-4976-9ea7-79d9006b2b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Flow 'volume_create_manager' (bf94c18b-6fcb-4713-bf8d-1a0b6645840e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a2e224e1-2d42-4ccc-b369-e78616637999 tempest-GroupsTest-205502653 None] Created volume successfully.
Jul 06 20:49:47 devstack sudo[92038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:47 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:48 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 0.959s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:48 devstack sudo[92043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af
Jul 06 20:49:48 devstack sudo[92043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:48 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:49:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Flow 'volume_create_manager' (466cebd2-99d0-4b2d-b700-51c02421e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97403015-5227-4361-b9da-571f55561584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97403015-5227-4361-b9da-571f55561584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-153091971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e67ed5c2-6e02-4601-874e-652e50386ffa,host='devstack@QuobyteHD#QuobyteHD',id=c09b0116-8377-4cac-baeb-8a5c619483af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853b16327f0e4b9fbfaa7e4ba8569a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:49Z,use_quota=True,user_id='a9757c9d13514df98aeab81e750d016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35098f74-6719-4dd3-8847-404498422e03),volume_type_id=35098f74-6719-4dd3-8847-404498422e03)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b300e9-0b8c-49ed-b588-4cae550f216a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b300e9-0b8c-49ed-b588-4cae550f216a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8d0c4c-3776-4e6f-974d-1fd1e69c64b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8d0c4c-3776-4e6f-974d-1fd1e69c64b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c09b0116-8377-4cac-baeb-8a5c619483af', 'volume_name': 'volume-c09b0116-8377-4cac-baeb-8a5c619483af', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e11e5ad-05e9-41bb-97c7-1ddf4f6aac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e11e5ad-05e9-41bb-97c7-1ddf4f6aac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaa3d31-7f1f-4117-a88f-9359dcf68165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:49 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Volume c09b0116-8377-4cac-baeb-8a5c619483af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c09b0116-8377-4cac-baeb-8a5c619483af', 'volume_size': 1}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=e67ed5c2-6e02-4601-874e-652e50386ffa,created_at=2026-07-06T18:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-153091971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=e67ed5c2-6e02-4601-874e-652e50386ffa,host='devstack@QuobyteHD#QuobyteHD',id=c09b0116-8377-4cac-baeb-8a5c619483af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853b16327f0e4b9fbfaa7e4ba8569a30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:49:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:49:49Z,use_quota=True,user_id='a9757c9d13514df98aeab81e750d016c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(35098f74-6719-4dd3-8847-404498422e03),volume_type_id=35098f74-6719-4dd3-8847-404498422e03)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Creating volume c09b0116-8377-4cac-baeb-8a5c619483af {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:49:49 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:49 devstack sudo[92045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af 1073741824
Jul 06 20:49:49 devstack sudo[92045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:49 devstack sudo[92043]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" returned: 0 in 1.161s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:49 devstack sudo[92054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af
Jul 06 20:49:49 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:50 devstack sudo[92045]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af 1073741824" returned: 0 in 1.174s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:50 devstack sudo[92057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af
Jul 06 20:49:50 devstack sudo[92057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:50 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" returned: 0 in 0.859s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-a07f9ade-3da2-46ee-8a9e-f8a2f923a4af" released by "_delete_snapshot" :: held 4.080s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" released by "delete_snapshot" :: held 4.105s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:50 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Created reservations ['872d5a10-fdec-41c5-b46f-a480f9141380', '84ac8a18-186b-48bf-a71d-2755850ef815', '267bd78a-9ffe-4589-adb0-34398fe0deaa', 'cc86a358-096d-4667-acaa-5c610c33ef9f'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:49:50 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Delete snapshot completed successfully.
Jul 06 20:49:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4a291b4d-94dc-49f9-a459-bc668c926bbe tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-a07f9ade-3da2-46ee-8a9e-f8a2f923a4af-delete_snapshot" released by "delete_snapshot" :: held 4.285s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:51 devstack sudo[92057]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:49:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6aaa3d31-7f1f-4117-a88f-9359dcf68165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c09b0116-8377-4cac-baeb-8a5c619483af', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba959a22-c500-4dea-a0c1-93a9b955f1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:49:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Volume volume-c09b0116-8377-4cac-baeb-8a5c619483af (c09b0116-8377-4cac-baeb-8a5c619483af): created successfully
Jul 06 20:49:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba959a22-c500-4dea-a0c1-93a9b955f1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:49:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Flow 'volume_create_manager' (466cebd2-99d0-4b2d-b700-51c02421e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:49:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a68a469d-bdc1-430f-9613-77dd1c3eb177 tempest-GroupsTest-205502653 None] Created volume successfully.
Jul 06 20:49:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:49:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:49:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Creating offline snapshot 65ac25ab-5537-4853-92f9-709b90ecd07f of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:49:52 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db1f0c0-3f34-48c9-88b3-1a0df306d8ce]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:52 devstack sudo[92064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:52 devstack sudo[92064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-60937c41-40f5-4c86-be17-1a6a8ba56937 tempest-GroupsTest-205502653 None] Update group completed successfully.
Jul 06 20:49:53 devstack sudo[92064]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.183s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:53 devstack sudo[92070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f 1G
Jul 06 20:49:53 devstack sudo[92070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-371b0804-bff6-4f29-9c46-56655ec03016 req-47d5c0f5-25be-4682-89c4-7ec7b758cbd4 tempest-ServerActionsTestOtherA-496397566 None] Terminate volume connection completed successfully.
Jul 06 20:49:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-371b0804-bff6-4f29-9c46-56655ec03016 req-47d5c0f5-25be-4682-89c4-7ec7b758cbd4 tempest-ServerActionsTestOtherA-496397566 None] Deleting attachment f6e6e2eb-a0f0-483e-baa3-cadb73b0c531. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:49:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c18b50e4-3bb6-42cc-b074-5c8b9955c37d tempest-GroupsTest-205502653 None] Update group completed successfully.
Jul 06 20:49:54 devstack sudo[92070]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f 1G" returned: 0 in 1.126s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:54 devstack sudo[92078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f
Jul 06 20:49:54 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:55 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f" returned: 0 in 0.799s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:55 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f is being set with open permissions: ugo+rw
Jul 06 20:49:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:55 devstack sudo[92083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f
Jul 06 20:49:55 devstack sudo[92083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Acquiring lock "cinder-quobyte-4a908638-b8da-4086-8aee-ca976d8f99ef" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:56 devstack sudo[92083]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f" returned: 0 in 0.974s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Lock "cinder-quobyte-4a908638-b8da-4086-8aee-ca976d8f99ef" acquired by "delete_volume" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.224s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:49:56 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46a19ac-4db8-4879-adb2-0e2cd31daf2a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-50c12789-1449-40f3-b5ed-4b22c7f83738 tempest-SnapshotsActionsTest-679787021 None] Create snapshot completed successfully
Jul 06 20:49:56 devstack sudo[92088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef
Jul 06 20:49:56 devstack sudo[92088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:57 devstack sudo[92088]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef" returned: 0 in 0.936s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:57 devstack sudo[92099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef
Jul 06 20:49:57 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-65ac25ab-5537-4853-92f9-709b90ecd07f-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-65ac25ab-5537-4853-92f9-709b90ecd07f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-65ac25ab-5537-4853-92f9-709b90ecd07f" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-65ac25ab-5537-4853-92f9-709b90ecd07f" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Deleting offline snapshot 65ac25ab-5537-4853-92f9-709b90ecd07f of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] snapshot_file for this snap is: volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2febbd81-329a-45d6-822f-24fa9a16a65d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:58 devstack sudo[92113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f
Jul 06 20:49:58 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:58 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a908638-b8da-4086-8aee-ca976d8f99ef" returned: 0 in 1.014s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Lock "cinder-quobyte-4a908638-b8da-4086-8aee-ca976d8f99ef" released by "delete_volume" :: held 2.022s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Acquiring lock "cinder-quobyte-c09b0116-8377-4cac-baeb-8a5c619483af" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Lock "cinder-quobyte-c09b0116-8377-4cac-baeb-8a5c619483af" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4450be6-066e-457a-97d7-d8699a04a4b9]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:58 devstack sudo[92124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af
Jul 06 20:49:58 devstack sudo[92124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:58 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f" returned: 0 in 1.001s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:59 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed297285-ad67-4584-b19c-b5dd19b9b6df]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:49:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:59 devstack sudo[92130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:49:59 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:59 devstack sudo[92124]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af" returned: 0 in 1.163s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:49:59 devstack sudo[92137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af
Jul 06 20:49:59 devstack sudo[92137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:49:59 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root
Jul 06 20:49:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 0.958s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:49:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:49:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:00 devstack sudo[92142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f
Jul 06 20:50:00 devstack sudo[92142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:00 devstack sudo[92137]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c09b0116-8377-4cac-baeb-8a5c619483af" returned: 0 in 0.773s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Lock "cinder-quobyte-c09b0116-8377-4cac-baeb-8a5c619483af" released by "delete_volume" :: held 2.004s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:00 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Created reservations ['db216fff-d207-4d79-a237-2eb9c3372095'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:00 devstack cinder-volume[86721]: WARNING cinder.quota [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2041674621 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2041674621, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:50:00 devstack cinder-volume[86721]: WARNING cinder.quota [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2041674621 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2041674621, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:50:00 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Created reservations ['6efad983-4eff-4878-b965-61d35c7d7bb6', '712b2116-d328-4c2c-90c3-8d7594d2ba51', 'cbff1072-3609-47a7-9863-4da17360e914', '65bdc29d-f77b-448e-9dec-e32220ef7bab'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:00 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Created reservations ['527ac60b-9848-4ec8-9f40-7c863bfc6950', '8f75d5aa-5c48-4626-9b0b-626c5abc96c0', '62e5c5c1-9494-4be2-9eaf-3a990a1382f0', '764df44d-4833-472f-a460-93dc2d23a201'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:00 devstack sudo[92142]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f" returned: 0 in 0.990s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:00 devstack sudo[92150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f
Jul 06 20:50:00 devstack sudo[92150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:01 devstack sudo[92153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:01 devstack sudo[92153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:01 devstack sudo[92153]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:01 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:01 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b123633d-2ffa-4d60-a803-0b59f739c035 tempest-GroupsTest-205502653 None] Delete group completed successfully.
Jul 06 20:50:02 devstack sudo[92150]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.65ac25ab-5537-4853-92f9-709b90ecd07f" returned: 0 in 1.132s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-65ac25ab-5537-4853-92f9-709b90ecd07f" released by "_delete_snapshot" :: held 4.234s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" released by "delete_snapshot" :: held 4.291s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:02 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Created reservations ['f0e2b1bd-6f57-4d39-b577-0d819c0ebed6', '0c8b8b00-fd66-4caa-b786-545a5d26a3dd', '7f9af361-460a-4e76-a0c4-cebd2131d865', '49f8d444-7279-4370-b923-644d8370d1c3'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:02 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Delete snapshot completed successfully.
Jul 06 20:50:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a30f0085-ba55-41c5-82d8-30f22c7be6bd tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-65ac25ab-5537-4853-92f9-709b90ecd07f-delete_snapshot" released by "delete_snapshot" :: held 4.473s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Creating offline snapshot dc9f609f-d20d-4207-95e5-bf11655317c5 of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:50:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbb96b7-f54f-4d40-ae05-98e841bbb36e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:03 devstack sudo[92199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:50:03 devstack sudo[92199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:04 devstack sudo[92199]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 0.890s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:50:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:04 devstack sudo[92204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 1G
Jul 06 20:50:04 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Acquiring lock "cinder-65191642-911c-4d61-b61a-d2d8e2ef3634-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Lock "cinder-65191642-911c-4d61-b61a-d2d8e2ef3634-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Acquiring lock "cinder-quobyte-65191642-911c-4d61-b61a-d2d8e2ef3634" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Lock "cinder-quobyte-65191642-911c-4d61-b61a-d2d8e2ef3634" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d8500-8b9d-4f5e-b407-4bc48bcfbd9b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:05 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 1G" returned: 0 in 1.101s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:05 devstack sudo[92210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5
Jul 06 20:50:05 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:05 devstack sudo[92209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634
Jul 06 20:50:05 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:06 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5" returned: 0 in 0.803s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:06 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 is being set with open permissions: ugo+rw
Jul 06 20:50:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:06 devstack sudo[92219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5
Jul 06 20:50:06 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:06 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634" returned: 0 in 0.866s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:06 devstack sudo[92221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634
Jul 06 20:50:06 devstack sudo[92221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:07 devstack sudo[92221]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65191642-911c-4d61-b61a-d2d8e2ef3634" returned: 0 in 0.731s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Lock "cinder-quobyte-65191642-911c-4d61-b61a-d2d8e2ef3634" released by "delete_volume" :: held 1.655s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:07 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5" returned: 0 in 0.815s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.764s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f5278cf8-588c-4b15-b382-161a477c5e23 tempest-SnapshotsActionsTest-679787021 None] Create snapshot completed successfully
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Created reservations ['95ee2658-bb70-44cb-83db-b5ef031192d4', '0b87c221-983a-40cb-9efa-ec98d7adf540', 'ff9e37d5-bac6-45e3-a7ea-8d20cf2dc571', '241c9f49-f268-4224-b596-f2b4cd74e3cf'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:07 devstack sudo[92226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:07 devstack sudo[92226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a3c90312-7e88-468d-a558-c90927ab6cc0 tempest-GroupsV320Test-1845328078 None] Group tempest-GroupsV320Test-Group-1621267853: creating
Jul 06 20:50:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a3c90312-7e88-468d-a558-c90927ab6cc0 tempest-GroupsV320Test-1845328078 None] Group tempest-GroupsV320Test-Group-1621267853: created successfully
Jul 06 20:50:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a3c90312-7e88-468d-a558-c90927ab6cc0 tempest-GroupsV320Test-1845328078 None] Create group completed successfully.
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-dc9f609f-d20d-4207-95e5-bf11655317c5-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-dc9f609f-d20d-4207-95e5-bf11655317c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Acquiring lock "cinder-quobyte-dc9f609f-d20d-4207-95e5-bf11655317c5" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-dc9f609f-d20d-4207-95e5-bf11655317c5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Deleting offline snapshot dc9f609f-d20d-4207-95e5-bf11655317c5 of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] snapshot_file for this snap is: volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e148ab71-843d-4ee1-a467-a63dff02bceb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:08 devstack sudo[92229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5
Jul 06 20:50:08 devstack sudo[92229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:08 devstack sudo[92226]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.988s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Deleted volume successfully.
Jul 06 20:50:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-864732f0-2e13-4229-b764-2ceb6ae2f53e tempest-ServerActionsTestOtherA-496397566 None] Lock "cinder-65191642-911c-4d61-b61a-d2d8e2ef3634-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:09 devstack sudo[92229]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5" returned: 0 in 1.114s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[164906f1-23be-46a0-9998-48fd144556f7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Created reservations ['6ad43b2a-3edb-46c6-adca-356140af1eb1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:09 devstack sudo[92243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:50:09 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:09 devstack sudo[92248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:09 devstack sudo[92248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:10 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.213s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:50:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:10 devstack sudo[92287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5
Jul 06 20:50:10 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:10 devstack sudo[92248]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.148s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:10 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-644b35b8-3238-4bb9-b622-72737cfd2e21 tempest-GroupsV320Test-1845328078 None] Delete group completed successfully.
Jul 06 20:50:11 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5" returned: 0 in 1.079s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:11 devstack sudo[92295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5
Jul 06 20:50:11 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:12 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.dc9f609f-d20d-4207-95e5-bf11655317c5" returned: 0 in 0.815s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-dc9f609f-d20d-4207-95e5-bf11655317c5" released by "_delete_snapshot" :: held 4.379s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" released by "delete_snapshot" :: held 4.409s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:12 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Created reservations ['c5bdd4f1-81e1-4a87-bf12-7c93cda5f102', '61294633-27e1-4546-a046-b70b5565cca1', 'fcc21f2d-c2ec-47c6-902b-9ab5e654291e', 'f57d6546-de77-493a-b603-0d7cd17ac438'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Delete snapshot completed successfully.
Jul 06 20:50:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bdbfa4d4-210b-4961-8662-dbd5fe5c4322 tempest-SnapshotsActionsTest-2113887933 None] Lock "cinder-dc9f609f-d20d-4207-95e5-bf11655317c5-delete_snapshot" released by "delete_snapshot" :: held 4.617s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "cinder-0e718882-ac1f-4eed-9280-03430c6b3e6f-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-0e718882-ac1f-4eed-9280-03430c6b3e6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "cinder-quobyte-0e718882-ac1f-4eed-9280-03430c6b3e6f" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-quobyte-0e718882-ac1f-4eed-9280-03430c6b3e6f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Deleting offline snapshot 0e718882-ac1f-4eed-9280-03430c6b3e6f of volume 1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:50:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] snapshot_file for this snap is: volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:50:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[066cd17d-8a93-44ba-9ef0-689dfbd769a2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:14 devstack sudo[92312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:50:14 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:15 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.211s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d93e476-4df0-45e3-9e9d-e7850571135a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:50:15 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d45c73d-5264-416e-bbb7-ad553088677a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:15 devstack sudo[92352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a
Jul 06 20:50:15 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:16 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a" returned: 0 in 1.048s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:16 devstack sudo[92376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:50:16 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:17 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.032s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:17 devstack sudo[92384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f
Jul 06 20:50:17 devstack sudo[92384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:18 devstack sudo[92384]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a.0e718882-ac1f-4eed-9280-03430c6b3e6f" returned: 0 in 1.078s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-quobyte-0e718882-ac1f-4eed-9280-03430c6b3e6f" released by "_delete_snapshot" :: held 4.588s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" released by "delete_snapshot" :: held 4.629s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:18 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Created reservations ['0da1a1c6-fe88-4d55-92ac-49140ce3337e', '3a893642-f1b8-4d00-b22b-166540ad979a', '25ea37ea-fa85-4b5a-a2d1-4718b9e538f9', 'c3025bc5-57ef-4a74-bb9b-3cd131ed39d1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Delete snapshot completed successfully.
Jul 06 20:50:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-201cf569-8610-4042-a2f7-8ba82ea1b4f0 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-0e718882-ac1f-4eed-9280-03430c6b3e6f-delete_snapshot" released by "delete_snapshot" :: held 4.960s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "cinder-1d93e476-4df0-45e3-9e9d-e7850571135a-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-1d93e476-4df0-45e3-9e9d-e7850571135a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d727d01d-1ec5-43ce-957e-587f1ce63f0e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:19 devstack sudo[92388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a
Jul 06 20:50:19 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:20 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a" returned: 0 in 1.136s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:20 devstack sudo[92399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a
Jul 06 20:50:20 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:21 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1d93e476-4df0-45e3-9e9d-e7850571135a" returned: 0 in 0.852s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-quobyte-1d93e476-4df0-45e3-9e9d-e7850571135a" released by "delete_volume" :: held 2.080s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Created reservations ['5199e044-1101-4fab-886f-95559f227105', '822787fd-5785-4e4d-9576-921c6f457555', '6c1442d2-ec37-4025-909a-73fdb9149b16', '64d15cbe-d8da-403e-87e8-afcdd90eba8b'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:21 devstack sudo[92402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:22 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:23 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.053s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Deleted volume successfully.
Jul 06 20:50:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9b1d719a-e93f-4b6d-ab25-4f12cd344956 tempest-SnapshotsActionsTest-679787021 None] Lock "cinder-1d93e476-4df0-45e3-9e9d-e7850571135a-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Flow 'volume_create_manager' (cca9cf75-1eeb-4e26-ab5c-e78a32deed0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c706f3-b7bb-4d51-8ce5-08dc56fe97fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c706f3-b7bb-4d51-8ce5-08dc56fe97fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2033569145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5203bcc4-1e1d-489a-86db-0784961519b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37066afa7f6d4650a13deefab4850375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:29Z,use_quota=True,user_id='951640503fa741f69a9ddab273170086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3331db5-070c-4080-a0e6-0b5405045f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3331db5-070c-4080-a0e6-0b5405045f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5367d3-ecb0-4fcb-adf9-3c4cb81ba1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d5367d3-ecb0-4fcb-adf9-3c4cb81ba1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5203bcc4-1e1d-489a-86db-0784961519b5', 'volume_name': 'volume-5203bcc4-1e1d-489a-86db-0784961519b5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b4495e-74c2-4d3a-b9b4-947ff09efde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b4495e-74c2-4d3a-b9b4-947ff09efde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7213c708-5058-4b52-ad3c-02e3f7477bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:29 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Volume 5203bcc4-1e1d-489a-86db-0784961519b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5203bcc4-1e1d-489a-86db-0784961519b5', 'volume_size': 1}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2033569145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5203bcc4-1e1d-489a-86db-0784961519b5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37066afa7f6d4650a13deefab4850375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:29Z,use_quota=True,user_id='951640503fa741f69a9ddab273170086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Creating volume 5203bcc4-1e1d-489a-86db-0784961519b5 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:50:29 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:50:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:29 devstack sudo[92433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5 1073741824
Jul 06 20:50:29 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:30 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5 1073741824" returned: 0 in 0.984s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:30 devstack sudo[92438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5
Jul 06 20:50:30 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:31 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5" returned: 0 in 0.728s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:50:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7213c708-5058-4b52-ad3c-02e3f7477bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5203bcc4-1e1d-489a-86db-0784961519b5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e48717-2ed2-4e95-82cc-229f94a56fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:31 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Volume volume-5203bcc4-1e1d-489a-86db-0784961519b5 (5203bcc4-1e1d-489a-86db-0784961519b5): created successfully
Jul 06 20:50:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e48717-2ed2-4e95-82cc-229f94a56fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Flow 'volume_create_manager' (cca9cf75-1eeb-4e26-ab5c-e78a32deed0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-db0cf798-e4f0-43b1-bb17-d9a18f9aeb09 tempest-VolumesTestJSON-1363339229 None] Created volume successfully.
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Flow 'volume_create_manager' (7be014e3-b4bb-4cbd-919e-06aacae80dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37727154-62fa-4bb1-b35b-8c77dc331b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37727154-62fa-4bb1-b35b-8c77dc331b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384663322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5691e65b-f07b-4485-a937-49330fa403fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37066afa7f6d4650a13deefab4850375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:32Z,use_quota=True,user_id='951640503fa741f69a9ddab273170086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78fa7b5-176b-4606-b0a0-432c3006f8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78fa7b5-176b-4606-b0a0-432c3006f8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15fb8781-d965-416d-b472-bb9ec7efb599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15fb8781-d965-416d-b472-bb9ec7efb599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5691e65b-f07b-4485-a937-49330fa403fd', 'volume_name': 'volume-5691e65b-f07b-4485-a937-49330fa403fd', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf21cee-ae98-4182-a8d7-7795d6454399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cf21cee-ae98-4182-a8d7-7795d6454399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b0b36b-57d4-4a57-a970-0e3941a8327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:32 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Volume 5691e65b-f07b-4485-a937-49330fa403fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5691e65b-f07b-4485-a937-49330fa403fd', 'volume_size': 1}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1384663322',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5691e65b-f07b-4485-a937-49330fa403fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37066afa7f6d4650a13deefab4850375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:32Z,use_quota=True,user_id='951640503fa741f69a9ddab273170086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Creating volume 5691e65b-f07b-4485-a937-49330fa403fd {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:50:32 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:50:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:32 devstack sudo[92441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd 1073741824
Jul 06 20:50:32 devstack sudo[92441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:33 devstack sudo[92441]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd 1073741824" returned: 0 in 1.036s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:33 devstack sudo[92446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd
Jul 06 20:50:33 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:34 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd" returned: 0 in 0.760s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:50:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b0b36b-57d4-4a57-a970-0e3941a8327c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5691e65b-f07b-4485-a937-49330fa403fd', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b1db19-4123-42f5-a0ec-d9aaed29b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:34 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Volume volume-5691e65b-f07b-4485-a937-49330fa403fd (5691e65b-f07b-4485-a937-49330fa403fd): created successfully
Jul 06 20:50:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12b1db19-4123-42f5-a0ec-d9aaed29b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Flow 'volume_create_manager' (7be014e3-b4bb-4cbd-919e-06aacae80dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:34 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ae183836-9122-4710-b379-bcf2f9ebe05a tempest-VolumesTestJSON-1363339229 None] Created volume successfully.
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=93,cinder:UPDATE=110,cinder:DELETE=4,cinder:INSERT=31 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:INSERT=22,cinder:UPDATE=104,cinder:SELECT=96,cinder:DELETE=7 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Flow 'volume_create_manager' (bad0ecf3-1650-4a98-bc18-b7ef0272dd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2302c8f4-2715-473e-a3b7-164c0fd84996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2302c8f4-2715-473e-a3b7-164c0fd84996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1935894243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3536e4f5-593f-4a8d-b558-70d724111596,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37066afa7f6d4650a13deefab4850375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:36Z,use_quota=True,user_id='951640503fa741f69a9ddab273170086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e372d7-99ee-4e11-bef4-13864634cf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94e372d7-99ee-4e11-bef4-13864634cf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76610b41-af9e-4a40-b2b6-5469212095ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76610b41-af9e-4a40-b2b6-5469212095ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3536e4f5-593f-4a8d-b558-70d724111596', 'volume_name': 'volume-3536e4f5-593f-4a8d-b558-70d724111596', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4b120a-a670-4a26-b152-ec9f03175499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd4b120a-a670-4a26-b152-ec9f03175499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5500359-39d1-4e1d-9b36-fdcb8bc8b7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:36 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Volume 3536e4f5-593f-4a8d-b558-70d724111596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3536e4f5-593f-4a8d-b558-70d724111596', 'volume_size': 1}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1935894243',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3536e4f5-593f-4a8d-b558-70d724111596,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37066afa7f6d4650a13deefab4850375',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:36Z,use_quota=True,user_id='951640503fa741f69a9ddab273170086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Creating volume 3536e4f5-593f-4a8d-b558-70d724111596 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:50:36 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:50:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:36 devstack sudo[92449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596 1073741824
Jul 06 20:50:36 devstack sudo[92449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:37 devstack sudo[92449]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596 1073741824" returned: 0 in 1.274s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:37 devstack sudo[92456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:37 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:37 devstack sudo[92458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596
Jul 06 20:50:37 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:38 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.083s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:50:38 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596" returned: 0 in 1.058s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] <== create_volume: return (2431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5500359-39d1-4e1d-9b36-fdcb8bc8b7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3536e4f5-593f-4a8d-b558-70d724111596', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3206ad8a-97ef-485f-9846-381ffad8bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Volume volume-3536e4f5-593f-4a8d-b558-70d724111596 (3536e4f5-593f-4a8d-b558-70d724111596): created successfully
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3206ad8a-97ef-485f-9846-381ffad8bd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Flow 'volume_create_manager' (bad0ecf3-1650-4a98-bc18-b7ef0272dd2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-92df977f-591f-44a4-bdf5-419ae8806b5b tempest-VolumesTestJSON-1363339229 None] Created volume successfully.
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Flow 'volume_create_manager' (e3eccab9-0183-4ea8-b121-dabcd08bfb55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ae14d7-00e2-49d5-94c1-988d2926139c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6ae14d7-00e2-49d5-94c1-988d2926139c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2040688343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a20df87-6c5b-4f39-b31c-213632b79f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d3cf64659248b7be39257f1c0801a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:39Z,use_quota=True,user_id='55d722cfd5d64f36a4d2e16dcf67377c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a318b297-b6a8-42cf-bd20-ce1bc938742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a318b297-b6a8-42cf-bd20-ce1bc938742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1c21bd-dee7-4e56-a9c4-8cf22b4d1aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c1c21bd-dee7-4e56-a9c4-8cf22b4d1aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a20df87-6c5b-4f39-b31c-213632b79f08', 'volume_name': 'volume-4a20df87-6c5b-4f39-b31c-213632b79f08', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01ec460-1e4e-4a47-ba9d-6e0238802165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01ec460-1e4e-4a47-ba9d-6e0238802165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81be9bcc-fb9b-41dd-b17b-d0e56e537931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Volume 4a20df87-6c5b-4f39-b31c-213632b79f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a20df87-6c5b-4f39-b31c-213632b79f08', 'volume_size': 1}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2040688343',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a20df87-6c5b-4f39-b31c-213632b79f08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d3cf64659248b7be39257f1c0801a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:39Z,use_quota=True,user_id='55d722cfd5d64f36a4d2e16dcf67377c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Creating volume 4a20df87-6c5b-4f39-b31c-213632b79f08 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:50:38 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:50:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:38 devstack sudo[92463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08 1073741824
Jul 06 20:50:38 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:39 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08 1073741824" returned: 0 in 0.937s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:39 devstack sudo[92469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08
Jul 06 20:50:39 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Acquiring lock "cinder-3536e4f5-593f-4a8d-b558-70d724111596-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:40 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08" returned: 0 in 0.715s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] <== create_volume: return (1698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Lock "cinder-3536e4f5-593f-4a8d-b558-70d724111596-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81be9bcc-fb9b-41dd-b17b-d0e56e537931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a20df87-6c5b-4f39-b31c-213632b79f08', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea72a2b-4510-4601-a684-09e7d8ebc3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:40 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Volume volume-4a20df87-6c5b-4f39-b31c-213632b79f08 (4a20df87-6c5b-4f39-b31c-213632b79f08): created successfully
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ea72a2b-4510-4601-a684-09e7d8ebc3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Flow 'volume_create_manager' (e3eccab9-0183-4ea8-b121-dabcd08bfb55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Acquiring lock "cinder-quobyte-3536e4f5-593f-4a8d-b558-70d724111596" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-53d13e26-c195-42dc-900e-edc96b74c19b tempest-VolumeQuotasAdminTestJSON-198356104 None] Created volume successfully.
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Lock "cinder-quobyte-3536e4f5-593f-4a8d-b558-70d724111596" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797a876-7e51-491e-94f9-4660df52149a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:40 devstack sudo[92472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596
Jul 06 20:50:40 devstack sudo[92472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Acquiring lock "cinder-4a20df87-6c5b-4f39-b31c-213632b79f08-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "cinder-4a20df87-6c5b-4f39-b31c-213632b79f08-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Acquiring lock "cinder-quobyte-4a20df87-6c5b-4f39-b31c-213632b79f08" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "cinder-quobyte-4a20df87-6c5b-4f39-b31c-213632b79f08" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8031fc-5cdf-485e-ac5b-ce20ab907aab]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:41 devstack sudo[92476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08
Jul 06 20:50:41 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Flow 'volume_create_manager' (e1763a97-5508-4ad3-8e3c-76e24192e2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1707e8d-9a51-40e3-90bc-25a363c03617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1707e8d-9a51-40e3-90bc-25a363c03617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-216402269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d6f8ef-9bd8-4601-8166-73b30b58bc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c66902c1f634f6293b953ae03a3279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:41Z,use_quota=True,user_id='8fec1432dc3344ee8c9759f07cb2a4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ef2add-515f-4496-af15-e67240acfa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73ef2add-515f-4496-af15-e67240acfa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2a6c83-5009-4b83-abad-b8d6264beff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f2a6c83-5009-4b83-abad-b8d6264beff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5d6f8ef-9bd8-4601-8166-73b30b58bc7c', 'volume_name': 'volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9146d3fe-86aa-4a3e-acf8-03becb027fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9146d3fe-86aa-4a3e-acf8-03becb027fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63735e2-30f2-4688-ae4b-4719e6437621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Volume d5d6f8ef-9bd8-4601-8166-73b30b58bc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c', 'volume_size': 1}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-216402269',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5d6f8ef-9bd8-4601-8166-73b30b58bc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c66902c1f634f6293b953ae03a3279b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:41Z,use_quota=True,user_id='8fec1432dc3344ee8c9759f07cb2a4e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Creating volume d5d6f8ef-9bd8-4601-8166-73b30b58bc7c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:50:41 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:41 devstack sudo[92478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c 1073741824
Jul 06 20:50:41 devstack sudo[92478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:41 devstack sudo[92472]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596" returned: 0 in 0.916s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:41 devstack sudo[92483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596
Jul 06 20:50:41 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:41 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08" returned: 0 in 0.825s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:41 devstack sudo[92488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08
Jul 06 20:50:41 devstack sudo[92488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:42 devstack sudo[92478]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c 1073741824" returned: 0 in 0.869s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:42 devstack sudo[92495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c
Jul 06 20:50:42 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:42 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3536e4f5-593f-4a8d-b558-70d724111596" returned: 0 in 0.724s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Lock "cinder-quobyte-3536e4f5-593f-4a8d-b558-70d724111596" released by "delete_volume" :: held 1.691s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Created reservations ['f6851248-d488-4c7b-b84e-fc763226308a', 'bdd339bf-51a8-4eec-ab55-d428f8939859', '58bc252e-aae5-46b3-a9bf-228144ddec29', '997a1bb2-f91f-469c-880b-b62fe7271e0c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:42 devstack sudo[92497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:42 devstack sudo[92497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:42 devstack sudo[92488]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4a20df87-6c5b-4f39-b31c-213632b79f08" returned: 0 in 0.713s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "cinder-quobyte-4a20df87-6c5b-4f39-b31c-213632b79f08" released by "delete_volume" :: held 1.597s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Created reservations ['c6641327-c8ab-4e4e-80d1-3dbe8a4d627d', '9349c216-b86a-41d8-a80a-30a8b11ffb7f', '3fa71533-75f4-4856-9dd8-12c0bf720dea', '4f2bac37-e66f-4416-987a-83c96ed16b37'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Acquiring lock "cinder-5691e65b-f07b-4485-a937-49330fa403fd-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Lock "cinder-5691e65b-f07b-4485-a937-49330fa403fd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:42 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:42 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Acquiring lock "cinder-quobyte-5691e65b-f07b-4485-a937-49330fa403fd" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Lock "cinder-quobyte-5691e65b-f07b-4485-a937-49330fa403fd" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaf53b3-164d-4d15-81a8-218efdc3d216]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:43 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c" returned: 0 in 0.740s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63735e2-30f2-4688-ae4b-4719e6437621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30204c5f-aae6-49bc-98ea-30ab2d30d481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Volume volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c (d5d6f8ef-9bd8-4601-8166-73b30b58bc7c): created successfully
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30204c5f-aae6-49bc-98ea-30ab2d30d481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Flow 'volume_create_manager' (e1763a97-5508-4ad3-8e3c-76e24192e2e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f489bf5e-ca88-4038-999e-77fc958491c3 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Created volume successfully.
Jul 06 20:50:43 devstack sudo[92503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd
Jul 06 20:50:43 devstack sudo[92503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:43 devstack sudo[92497]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.797s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Deleted volume successfully.
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b016e2dc-9ed3-47b3-8de6-ef3e3e17e842 tempest-VolumesTestJSON-1363339229 None] Lock "cinder-3536e4f5-593f-4a8d-b558-70d724111596-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:43 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.995s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Deleted volume successfully.
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-dbb3a6c1-9b2d-4803-845b-81885fef1f4a tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "cinder-4a20df87-6c5b-4f39-b31c-213632b79f08-delete_volume" released by "delete_volume" :: held 2.846s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Flow 'volume_create_manager' (450d3696-5cdb-4631-99bb-fa3f9593de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:43 devstack sudo[92503]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496e4f14-7c19-4a1f-83e8-a452263e7b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd" returned: 0 in 0.984s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (496e4f14-7c19-4a1f-83e8-a452263e7b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1598040365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fa4fe3-0745-4892-bb0b-92f186dcdb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d3cf64659248b7be39257f1c0801a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:44Z,use_quota=True,user_id='55d722cfd5d64f36a4d2e16dcf67377c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794cf2eb-573a-489e-bb5b-89fd6cff80bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack sudo[92516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd
Jul 06 20:50:44 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (794cf2eb-573a-489e-bb5b-89fd6cff80bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24435fb-5237-41e8-bfa9-3e8d0e583e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d24435fb-5237-41e8-bfa9-3e8d0e583e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49fa4fe3-0745-4892-bb0b-92f186dcdb0b', 'volume_name': 'volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfe46f0-2ea9-40db-8c26-9cabc2de9ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acfe46f0-2ea9-40db-8c26-9cabc2de9ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a203598-8386-4b8f-ba72-dee167d33dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Volume 49fa4fe3-0745-4892-bb0b-92f186dcdb0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b', 'volume_size': 1}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1598040365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49fa4fe3-0745-4892-bb0b-92f186dcdb0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84d3cf64659248b7be39257f1c0801a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:44Z,use_quota=True,user_id='55d722cfd5d64f36a4d2e16dcf67377c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Creating volume 49fa4fe3-0745-4892-bb0b-92f186dcdb0b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:50:44 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:44 devstack sudo[92518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b 1073741824
Jul 06 20:50:44 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Flow 'volume_create_manager' (3072d17c-9a0b-487c-a45b-00fcf3f4655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d014eb23-4666-4c6a-b90f-f4ef617611ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d014eb23-4666-4c6a-b90f-f4ef617611ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1136634066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d6ea94-f95a-4055-a7c8-228df28198fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b855a0dca0437ca9bedc25444d8557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:45Z,use_quota=True,user_id='87f326d2051b40138255c18ccb9d8825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b39621-74e4-4749-adf5-5ed43530e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2b39621-74e4-4749-adf5-5ed43530e21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd51a34f-9110-483e-bc27-9cf36b85f6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd51a34f-9110-483e-bc27-9cf36b85f6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d6ea94-f95a-4055-a7c8-228df28198fb', 'volume_name': 'volume-f0d6ea94-f95a-4055-a7c8-228df28198fb', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58090234-9f48-4746-a0de-a462e591dddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58090234-9f48-4746-a0de-a462e591dddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250dd09c-5138-4f4d-996c-fcdb3f9bcff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:44 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Volume f0d6ea94-f95a-4055-a7c8-228df28198fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d6ea94-f95a-4055-a7c8-228df28198fb', 'volume_size': 1}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:44 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5691e65b-f07b-4485-a937-49330fa403fd" returned: 0 in 0.800s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Lock "cinder-quobyte-5691e65b-f07b-4485-a937-49330fa403fd" released by "delete_volume" :: held 1.842s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Created reservations ['ac843661-b0e1-4941-9210-ba82c6e83678', '8a01dde3-ff70-4276-8a8c-a7fefc48c859', '4dbb84f6-8cc4-44fe-886f-54cc4ad0e632', 'f1f5654d-18d1-47c1-bd5d-82462be7fb6d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Acquiring lock "cinder-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:44 devstack sudo[92524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:44 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "cinder-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Acquiring lock "cinder-quobyte-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "cinder-quobyte-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd72623f-fe81-4e5d-ad58-ccc78dbd2809]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:45 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b 1073741824" returned: 0 in 1.077s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:45 devstack sudo[92527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c
Jul 06 20:50:45 devstack sudo[92527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:45 devstack sudo[92529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b
Jul 06 20:50:45 devstack sudo[92529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Acquiring lock "cinder-5203bcc4-1e1d-489a-86db-0784961519b5-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Lock "cinder-5203bcc4-1e1d-489a-86db-0784961519b5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Acquiring lock "cinder-quobyte-5203bcc4-1e1d-489a-86db-0784961519b5" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Lock "cinder-quobyte-5203bcc4-1e1d-489a-86db-0784961519b5" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f090e02b-8758-4508-b166-8bb76c304e75]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:45 devstack sudo[92531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5
Jul 06 20:50:45 devstack sudo[92531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:45 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.778s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Deleted volume successfully.
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-606d5938-8062-43d2-988f-9ecc4523146e tempest-VolumesTestJSON-1363339229 None] Lock "cinder-5691e65b-f07b-4485-a937-49330fa403fd-delete_volume" released by "delete_volume" :: held 2.896s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:45 devstack sudo[92529]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b" returned: 0 in 0.747s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.245s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1136634066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d6ea94-f95a-4055-a7c8-228df28198fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b855a0dca0437ca9bedc25444d8557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:50:45Z,use_quota=True,user_id='87f326d2051b40138255c18ccb9d8825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Creating volume f0d6ea94-f95a-4055-a7c8-228df28198fb {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:50:45 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:45 devstack sudo[92527]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c" returned: 0 in 0.910s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:45 devstack sudo[92538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb 1073741824
Jul 06 20:50:45 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a203598-8386-4b8f-ba72-dee167d33dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:46 devstack sudo[92539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c
Jul 06 20:50:46 devstack sudo[92539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af7fd15-8565-4bcd-9e4f-45d9e336b08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:46 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Volume volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b (49fa4fe3-0745-4892-bb0b-92f186dcdb0b): created successfully
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af7fd15-8565-4bcd-9e4f-45d9e336b08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Flow 'volume_create_manager' (450d3696-5cdb-4631-99bb-fa3f9593de1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b0af0ed4-4058-4f2c-a838-5544d9bdad2e tempest-VolumeQuotasAdminTestJSON-198356104 None] Created volume successfully.
Jul 06 20:50:46 devstack sudo[92531]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5" returned: 0 in 0.863s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:46 devstack sudo[92545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5
Jul 06 20:50:46 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:46 devstack sudo[92539]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c" returned: 0 in 0.718s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "cinder-quobyte-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c" released by "delete_volume" :: held 1.669s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Created reservations ['5964ff53-dc2d-4ca8-beac-ccbb9980ed23', '6d62c24c-27e0-4e3a-9c1c-0bf3df519b0c', '8c10de33-89a1-49de-8ace-fa61ead246ce', 'ed7b8da6-0dfa-41ae-b5d2-a1ef7559fbf5'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:46 devstack sudo[92552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:46 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:46 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb 1073741824" returned: 0 in 0.937s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:46 devstack sudo[92555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb
Jul 06 20:50:46 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:47 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5203bcc4-1e1d-489a-86db-0784961519b5" returned: 0 in 0.685s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Lock "cinder-quobyte-5203bcc4-1e1d-489a-86db-0784961519b5" released by "delete_volume" :: held 1.610s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Created reservations ['8846bdef-3fcb-474d-a8a9-45b292c1cbe2', '4da708ea-131e-44b3-afad-40e7ad8c3be5', '1c54650f-7b5b-4ddf-bf43-54d6fde3fc07', '2205c5fe-e1b7-47a7-b64f-eca93ad97b8d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:47 devstack sudo[92558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:47 devstack sudo[92558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:47 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.811s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Deleted volume successfully.
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d0953560-9633-402a-ad7f-ba480ce70404 tempest-VolumeQuotasNegativeTestJSON-1156297594 None] Lock "cinder-d5d6f8ef-9bd8-4601-8166-73b30b58bc7c-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:47 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb" returned: 0 in 1.057s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250dd09c-5138-4f4d-996c-fcdb3f9bcff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d6ea94-f95a-4055-a7c8-228df28198fb', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6448ac-b880-484e-a2f8-de9c731c5195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:50:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b83c322e-46b2-46fb-be1e-40da05ab0c9c tempest-VolumeQuotasAdminTestJSON-1751647387 None] Transfer volume completed successfully.
Jul 06 20:50:48 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Volume volume-f0d6ea94-f95a-4055-a7c8-228df28198fb (f0d6ea94-f95a-4055-a7c8-228df28198fb): created successfully
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6448ac-b880-484e-a2f8-de9c731c5195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Flow 'volume_create_manager' (3072d17c-9a0b-487c-a45b-00fcf3f4655a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:50:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1ef7cfdc-3dee-429c-9c22-a618b95202ef tempest-AttachVolumeTestJSON-1874748075 None] Created volume successfully.
Jul 06 20:50:48 devstack sudo[92558]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.926s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Deleted volume successfully.
Jul 06 20:50:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d195d281-0240-4fe8-9117-fbcc9b3df1fa tempest-VolumesTestJSON-1363339229 None] Lock "cinder-5203bcc4-1e1d-489a-86db-0784961519b5-delete_volume" released by "delete_volume" :: held 2.888s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Acquiring lock "cinder-49fa4fe3-0745-4892-bb0b-92f186dcdb0b-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Lock "cinder-49fa4fe3-0745-4892-bb0b-92f186dcdb0b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Acquiring lock "cinder-quobyte-49fa4fe3-0745-4892-bb0b-92f186dcdb0b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:50:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Lock "cinder-quobyte-49fa4fe3-0745-4892-bb0b-92f186dcdb0b" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:50:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea85bb61-0c66-4328-bc9e-5d3b05765d07]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:49 devstack sudo[92567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b
Jul 06 20:50:49 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:50 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b" returned: 0 in 0.861s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:50 devstack sudo[92573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b
Jul 06 20:50:50 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:50 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-49fa4fe3-0745-4892-bb0b-92f186dcdb0b" returned: 0 in 0.775s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Lock "cinder-quobyte-49fa4fe3-0745-4892-bb0b-92f186dcdb0b" released by "delete_volume" :: held 1.685s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:50 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Created reservations ['f216ea1a-2eef-42e7-ab46-e6e274befbac', '7c25cf84-9b10-4de8-9ba2-5e1b9a12cd66', 'a17c0cc6-45c0-494b-9a53-54b99f29ff30', 'aa026381-3c15-4ed3-96bc-2a43ab012503'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:51 devstack sudo[92576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:50:51 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:51 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.766s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:50:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Deleted volume successfully.
Jul 06 20:50:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0db88d60-bb24-4fc4-935d-9c8d660fd3f0 tempest-VolumeQuotasAdminTestJSON-1405464796 None] Lock "cinder-49fa4fe3-0745-4892-bb0b-92f186dcdb0b-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:50:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-e205a65b-e5b8-4b3a-b10d-bfa023db271e req-b78472fb-ffff-45f6-bc32-8431b3b1653e tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:50:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-e205a65b-e5b8-4b3a-b10d-bfa023db271e req-b78472fb-ffff-45f6-bc32-8431b3b1653e tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:50:52 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[596451ba-6ce2-48f4-8ae7-d85e35ba0e52]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:50:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-e205a65b-e5b8-4b3a-b10d-bfa023db271e req-b78472fb-ffff-45f6-bc32-8431b3b1653e tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:50:52 devstack sudo[92588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb
Jul 06 20:50:52 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:50:53 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root
Jul 06 20:50:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-e205a65b-e5b8-4b3a-b10d-bfa023db271e req-b78472fb-ffff-45f6-bc32-8431b3b1653e tempest-AttachVolumeTestJSON-1874748075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb" returned: 0 in 0.951s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:50:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-e205a65b-e5b8-4b3a-b10d-bfa023db271e req-b78472fb-ffff-45f6-bc32-8431b3b1653e tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.973s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:50:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-e205a65b-e5b8-4b3a-b10d-bfa023db271e req-b78472fb-ffff-45f6-bc32-8431b3b1653e tempest-AttachVolumeTestJSON-1874748075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-f0d6ea94-f95a-4055-a7c8-228df28198fb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41461319-7fea-4d8c-9c56-8a17e09600b2', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:50:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-e205a65b-e5b8-4b3a-b10d-bfa023db271e req-b78472fb-ffff-45f6-bc32-8431b3b1653e tempest-AttachVolumeTestJSON-1874748075 None] attachment_update completed successfully.
Jul 06 20:50:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-775b330a-b627-4217-96ba-d9a81122ae03 tempest-GroupSnapshotsTest-2030955167 None] Group tempest-GroupSnapshotsTest-Group-1115872914: creating
Jul 06 20:50:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-775b330a-b627-4217-96ba-d9a81122ae03 tempest-GroupSnapshotsTest-2030955167 None] Group tempest-GroupSnapshotsTest-Group-1115872914: created successfully
Jul 06 20:50:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-775b330a-b627-4217-96ba-d9a81122ae03 tempest-GroupSnapshotsTest-2030955167 None] Create group completed successfully.
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (2ba90b84-b6a8-4062-af67-333d8558d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9477f4c9-0141-45f3-9a76-a54ddcdcb658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9477f4c9-0141-45f3-9a76-a54ddcdcb658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154898876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9040b87f-27ff-4395-b99a-c6ca6af2399e,host='devstack@QuobyteHD#QuobyteHD',id=364926fb-33f7-421d-921c-36d747adefd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:00Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72d9829f-059a-43a0-973e-b35982e157bf),volume_type_id=72d9829f-059a-43a0-973e-b35982e157bf)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7c9040-414c-4655-94b7-dbb12c2bb31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb7c9040-414c-4655-94b7-dbb12c2bb31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8a4b37-a1dd-4cdb-8d48-5b15ac24ff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8a4b37-a1dd-4cdb-8d48-5b15ac24ff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '364926fb-33f7-421d-921c-36d747adefd1', 'volume_name': 'volume-364926fb-33f7-421d-921c-36d747adefd1', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b8e1e3-66a3-44eb-8dcc-4b8fd77892bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b8e1e3-66a3-44eb-8dcc-4b8fd77892bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c21a789-643c-41ae-b346-ef49d267e25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Volume 364926fb-33f7-421d-921c-36d747adefd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-364926fb-33f7-421d-921c-36d747adefd1', 'volume_size': 1}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9040b87f-27ff-4395-b99a-c6ca6af2399e,created_at=2026-07-06T18:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-154898876',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9040b87f-27ff-4395-b99a-c6ca6af2399e,host='devstack@QuobyteHD#QuobyteHD',id=364926fb-33f7-421d-921c-36d747adefd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:00Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72d9829f-059a-43a0-973e-b35982e157bf),volume_type_id=72d9829f-059a-43a0-973e-b35982e157bf)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Creating volume 364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:00 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:51:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:00 devstack sudo[92983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 1073741824
Jul 06 20:51:00 devstack sudo[92983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Flow 'volume_create_manager' (0e738e07-7482-40ff-a4ba-119980e33e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eb2727-4147-4e3c-9543-5a7e04d999df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82eb2727-4147-4e3c-9543-5a7e04d999df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-896581724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7e86d0-d390-4a7a-aeba-8ac4f6722527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa1265981f440729ccc326327e141ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:01Z,use_quota=True,user_id='ca35132b8d52432dbea04d18c0dccdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a82d5b80-97d6-4694-8060-982d957a0819),volume_type_id=a82d5b80-97d6-4694-8060-982d957a0819)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ab7e89-edec-4340-b24b-ae82ac1cfcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ab7e89-edec-4340-b24b-ae82ac1cfcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a99a782-1a99-4d83-8451-34935c107e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a99a782-1a99-4d83-8451-34935c107e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f7e86d0-d390-4a7a-aeba-8ac4f6722527', 'volume_name': 'volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ffdee5-a1bd-4c96-927f-274db9dbacd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ffdee5-a1bd-4c96-927f-274db9dbacd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b499b5-0c1e-4740-9912-dd7a384af455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack sudo[92983]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:01 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Volume 8f7e86d0-d390-4a7a-aeba-8ac4f6722527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527', 'volume_size': 1}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 1073741824" returned: 0 in 1.000s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:01 devstack sudo[92990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1
Jul 06 20:51:01 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Flow 'volume_create_manager' (d0b9fdcf-1ae8-43af-9ca0-72b68c1d652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ac10c-834a-4056-8888-f69364ca6674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f92ac10c-834a-4056-8888-f69364ca6674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-589591745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44664e8-b030-4b13-8029-9689d95ee085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c8179ae6034211b11b5cbe6c91e7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:02Z,use_quota=True,user_id='f7fb1adc4f3f4048a6b204e3ab3c493c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4903fe5-f4a6-4395-a46e-ffcf56e7ed33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4903fe5-f4a6-4395-a46e-ffcf56e7ed33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331ecb11-9adb-4062-b2bf-7be3bcf536aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (331ecb11-9adb-4062-b2bf-7be3bcf536aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44664e8-b030-4b13-8029-9689d95ee085', 'volume_name': 'volume-b44664e8-b030-4b13-8029-9689d95ee085', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394f5186-20e0-46d9-aa9a-adf8af3fbe2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (394f5186-20e0-46d9-aa9a-adf8af3fbe2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837f4db0-88d8-4324-ac0d-2da20c610590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:01 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Volume b44664e8-b030-4b13-8029-9689d95ee085: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44664e8-b030-4b13-8029-9689d95ee085', 'volume_size': 1}
Jul 06 20:51:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:02 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1" returned: 0 in 0.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-896581724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f7e86d0-d390-4a7a-aeba-8ac4f6722527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faa1265981f440729ccc326327e141ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:01Z,use_quota=True,user_id='ca35132b8d52432dbea04d18c0dccdd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a82d5b80-97d6-4694-8060-982d957a0819),volume_type_id=a82d5b80-97d6-4694-8060-982d957a0819)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Creating volume 8f7e86d0-d390-4a7a-aeba-8ac4f6722527 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:02 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:02 devstack sudo[93030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527 1073741824
Jul 06 20:51:02 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c21a789-643c-41ae-b346-ef49d267e25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-364926fb-33f7-421d-921c-36d747adefd1', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dbefec-f258-4013-8e12-3da5ad24fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:02 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Volume volume-364926fb-33f7-421d-921c-36d747adefd1 (364926fb-33f7-421d-921c-36d747adefd1): created successfully
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80dbefec-f258-4013-8e12-3da5ad24fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (2ba90b84-b6a8-4062-af67-333d8558d45d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:02 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f5c11bb3-b8df-405e-9f6d-cf8bf215af94 tempest-GroupSnapshotsTest-2030955167 None] Created volume successfully.
Jul 06 20:51:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] GroupSnapshot 21847221-15d7-44b7-99a3-abaefd34afff: creating.
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Group snapshot 21847221-15d7-44b7-99a3-abaefd34afff: creating. {{(pid=86721) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:03 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527 1073741824" returned: 0 in 0.967s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:03 devstack sudo[93036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527
Jul 06 20:51:03 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:03 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527" returned: 0 in 0.644s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.190s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-589591745',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b44664e8-b030-4b13-8029-9689d95ee085,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c8179ae6034211b11b5cbe6c91e7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:02Z,use_quota=True,user_id='f7fb1adc4f3f4048a6b204e3ab3c493c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Creating volume b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:03 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:03 devstack sudo[93039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 1073741824
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97b499b5-0c1e-4740-9912-dd7a384af455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:03 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f51b6fd-b4bb-4eeb-bda8-74e2494afe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:03 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Volume volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527 (8f7e86d0-d390-4a7a-aeba-8ac4f6722527): created successfully
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f51b6fd-b4bb-4eeb-bda8-74e2494afe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Flow 'volume_create_manager' (0e738e07-7482-40ff-a4ba-119980e33e5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-942ccdc1-cfc6-4d82-9cff-b7de128a8805 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Created volume successfully.
Jul 06 20:51:04 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 1073741824" returned: 0 in 0.874s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:04 devstack sudo[93045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085
Jul 06 20:51:04 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:04 devstack sudo[93047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:51:04 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:05 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085" returned: 0 in 0.661s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.597s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.425s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (837f4db0-88d8-4324-ac0d-2da20c610590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44664e8-b030-4b13-8029-9689d95ee085', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73700bf9-8fd5-4e85-8abe-5c2ea781eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Creating offline snapshot 1229e64b-6c26-47fc-9deb-fcc8941e6698 of volume 364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:51:05 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.629s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:51:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-71b5ccea-fe0e-4e00-b9c7-a45c3919480e tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Retype volume completed successfully.
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96d9272-e88f-4d54-ba44-3ea93300dc5b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:05 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Volume volume-b44664e8-b030-4b13-8029-9689d95ee085 (b44664e8-b030-4b13-8029-9689d95ee085): created successfully
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73700bf9-8fd5-4e85-8abe-5c2ea781eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Flow 'volume_create_manager' (d0b9fdcf-1ae8-43af-9ca0-72b68c1d652b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-83f162eb-4291-44a0-889d-730432cda323 tempest-VolumesDeleteCascade-1915974569 None] Created volume successfully.
Jul 06 20:51:05 devstack sudo[93051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1
Jul 06 20:51:05 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Acquiring lock "cinder-8f7e86d0-d390-4a7a-aeba-8ac4f6722527-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "cinder-8f7e86d0-d390-4a7a-aeba-8ac4f6722527-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Acquiring lock "cinder-quobyte-8f7e86d0-d390-4a7a-aeba-8ac4f6722527" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "cinder-quobyte-8f7e86d0-d390-4a7a-aeba-8ac4f6722527" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fed05c-ea9f-430e-88d3-e9673b852165]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:06 devstack sudo[93054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527
Jul 06 20:51:06 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:06 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1" returned: 0 in 0.906s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:06 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 1G
Jul 06 20:51:06 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:07 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527" returned: 0 in 0.980s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:07 devstack sudo[93109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527
Jul 06 20:51:07 devstack sudo[93109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:07 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 1G" returned: 0 in 1.035s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364926fb-33f7-421d-921c-36d747adefd1 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:07 devstack sudo[93112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364926fb-33f7-421d-921c-36d747adefd1 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698
Jul 06 20:51:07 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:08 devstack sudo[93109]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8f7e86d0-d390-4a7a-aeba-8ac4f6722527" returned: 0 in 0.768s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "cinder-quobyte-8f7e86d0-d390-4a7a-aeba-8ac4f6722527" released by "delete_volume" :: held 1.791s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:08 devstack cinder-volume[86721]: WARNING cinder.quota [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:51:08 devstack cinder-volume[86721]: WARNING cinder.quota [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Created reservations ['4a389988-742a-4286-84fb-fdd3515ffce8', 'd2b7acf9-a902-4d3d-8e75-e4a4253f411d', 'e9f6b75d-6ba0-499a-81de-354df138ea01', 'b9a33ad0-07da-4ded-8319-7931d1fb493b'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:08 devstack sudo[93185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:51:08 devstack sudo[93185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:08 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-364926fb-33f7-421d-921c-36d747adefd1 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698" returned: 0 in 0.817s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:08 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:08 devstack sudo[93187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698
Jul 06 20:51:08 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:08 devstack sudo[93185]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.745s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:08 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:51:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Deleted volume successfully.
Jul 06 20:51:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d360c909-171c-416d-84d1-06308c5acf46 tempest-VolumeRetypeWithoutMigrationTest-1503879502 None] Lock "cinder-8f7e86d0-d390-4a7a-aeba-8ac4f6722527-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:09 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698" returned: 0 in 0.714s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:09 devstack sudo[93192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.info
Jul 06 20:51:09 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:09 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.info" returned: 0 in 0.679s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:09 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:51:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:09 devstack sudo[93202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.info
Jul 06 20:51:09 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:10 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.info" returned: 0 in 0.822s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.110s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.661s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Creating offline snapshot e5656235-6af6-4b6b-ac57-37de5a5510ba of volume b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:51:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e3d46b-2ef7-4097-84c4-ab24d1d915f0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b2ab9ce1-8a8a-4a69-a5d2-7cc6d613803a tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 21847221-15d7-44b7-99a3-abaefd34afff: created successfully
Jul 06 20:51:10 devstack sudo[93211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085
Jul 06 20:51:10 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:12 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085" returned: 0 in 1.494s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:12 devstack sudo[93596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba 1G
Jul 06 20:51:12 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:13 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba 1G" returned: 0 in 1.169s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44664e8-b030-4b13-8029-9689d95ee085 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:13 devstack sudo[93606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44664e8-b030-4b13-8029-9689d95ee085 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba
Jul 06 20:51:13 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:14 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44664e8-b030-4b13-8029-9689d95ee085 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba" returned: 0 in 0.865s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:14 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba is being set with open permissions: ugo+rw
Jul 06 20:51:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:14 devstack sudo[93611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba
Jul 06 20:51:14 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:14 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba" returned: 0 in 0.769s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:15 devstack sudo[93614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.info
Jul 06 20:51:15 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:15 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.info" returned: 0 in 0.958s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:15 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.info is being set with open permissions: ugo+rw
Jul 06 20:51:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:15 devstack sudo[93617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.info
Jul 06 20:51:15 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:16 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.info" returned: 0 in 0.803s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.165s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.670s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-1229e64b-6c26-47fc-9deb-fcc8941e6698-b078a256-594e-448f-adf6-51b172ccbb8d" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-1229e64b-6c26-47fc-9deb-fcc8941e6698-b078a256-594e-448f-adf6-51b172ccbb8d" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Creating volume b078a256-594e-448f-adf6-51b172ccbb8d from snapshot 1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-b078a256-594e-448f-adf6-51b172ccbb8d" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-de1087b5-d1eb-46f3-80db-5c30fbf4afd5 tempest-VolumesDeleteCascade-1915974569 None] Create snapshot completed successfully
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-b078a256-594e-448f-adf6-51b172ccbb8d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] snapshot: 1229e64b-6c26-47fc-9deb-fcc8941e6698, volume: b078a256-594e-448f-adf6-51b172ccbb8d,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ce971f-0f82-4923-a9a7-f7b063cbde7e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:17 devstack sudo[93620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698
Jul 06 20:51:17 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:17 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698" returned: 0 in 0.981s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364926fb-33f7-421d-921c-36d747adefd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:51:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:51:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:51:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb6b378-a0c9-4b84-a227-63ccc822341d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:18 devstack sudo[93627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1
Jul 06 20:51:18 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:18 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1" returned: 0 in 0.874s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:18 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:51:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:18 devstack sudo[93632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d
Jul 06 20:51:18 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:25 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d" returned: 0 in 7.052s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:25 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f3e96-aaed-467e-9725-57a282e24f16]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:25 devstack sudo[93672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1
Jul 06 20:51:25 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Flow 'volume_create_manager' (59c0c95a-58b8-46ee-a750-6692ac26f01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab413cd0-cfd3-4fcd-b67f-ff6ce56bdfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab413cd0-cfd3-4fcd-b67f-ff6ce56bdfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-207723571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cde66ca-bacb-4ed7-93b9-7c04ea14312d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118d5aa9415340f89150648f005c599e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:26Z,use_quota=True,user_id='88770fcd0f6d467a8b820d5a636437a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ccc802-d4e6-42a9-877a-21db06b88ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60ccc802-d4e6-42a9-877a-21db06b88ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4c34b5-9c0c-4d96-9bd3-00719e0cb29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b4c34b5-9c0c-4d96-9bd3-00719e0cb29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cde66ca-bacb-4ed7-93b9-7c04ea14312d', 'volume_name': 'volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93546197-5e7a-40a1-a9b7-1132dc59dfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93546197-5e7a-40a1-a9b7-1132dc59dfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd0aa67-15b5-4eb7-bd82-64fd059ef4eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Volume 1cde66ca-bacb-4ed7-93b9-7c04ea14312d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d', 'volume_size': 1}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:26 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1" returned: 0 in 0.970s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:51:26 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Converted 1024.00 MB image at 145.19 MB/s
Jul 06 20:51:26 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:51:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:26 devstack sudo[93677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d
Jul 06 20:51:26 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:27 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d" returned: 0 in 0.616s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-b078a256-594e-448f-adf6-51b172ccbb8d" released by "_copy_volume_from_snapshot" :: held 10.594s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-1229e64b-6c26-47fc-9deb-fcc8941e6698-b078a256-594e-448f-adf6-51b172ccbb8d" released by "_create_volume_from_snapshot" :: held 10.635s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.678s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.638s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Creating offline snapshot 83b3bfaa-0409-4eab-bed2-70a61295a7ce of volume b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[474b13f1-dcac-4e68-9093-41b5051aeced]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:27 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fd8b5cbd-6c4b-4635-a5df-59c7bfa9e9c4 tempest-GroupSnapshotsTest-2030955167 None] Create group from source-snapshot-21847221-15d7-44b7-99a3-abaefd34afff completed successfully.
Jul 06 20:51:27 devstack sudo[93681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba
Jul 06 20:51:27 devstack sudo[93681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:28 devstack sudo[93681]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba" returned: 0 in 0.789s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44664e8-b030-4b13-8029-9689d95ee085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:51:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:28 devstack sudo[93710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce 1G
Jul 06 20:51:28 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-b078a256-594e-448f-adf6-51b172ccbb8d" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-b078a256-594e-448f-adf6-51b172ccbb8d" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f884ec-9923-4730-8362-a7d9aaa56576]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:28 devstack sudo[93712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d
Jul 06 20:51:28 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:29 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce 1G" returned: 0 in 0.901s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:29 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d" returned: 0 in 0.774s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:29 devstack sudo[93720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce
Jul 06 20:51:29 devstack sudo[93720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:29 devstack sudo[93722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d
Jul 06 20:51:29 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:29 devstack sudo[93720]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce" returned: 0 in 0.689s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:29 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce is being set with open permissions: ugo+rw
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:29 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b078a256-594e-448f-adf6-51b172ccbb8d" returned: 0 in 0.676s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:29 devstack sudo[93728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce
Jul 06 20:51:29 devstack sudo[93728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-b078a256-594e-448f-adf6-51b172ccbb8d" released by "delete_volume" :: held 1.493s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['8ec06380-ba16-4ec1-ba86-b0b3927a5526'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:30 devstack cinder-volume[86721]: WARNING cinder.quota [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1736335357 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1736335357, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:51:30 devstack cinder-volume[86721]: WARNING cinder.quota [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1736335357 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1736335357, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['69737901-1ad2-4717-83a0-bbbcd948ad00', '8c393acc-0afd-415f-8323-bbb14fb706e4', 'e4c447c3-9be9-4925-9e42-3fef4e1ec41e', 'd83e2404-ac57-4d7e-a836-6e7e0b987003'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:30 devstack sudo[93730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:51:30 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:30 devstack sudo[93728]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce" returned: 0 in 0.647s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.147s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.224s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-207723571',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cde66ca-bacb-4ed7-93b9-7c04ea14312d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='118d5aa9415340f89150648f005c599e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:26Z,use_quota=True,user_id='88770fcd0f6d467a8b820d5a636437a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Creating volume 1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:30 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:30 devstack sudo[93733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d 1073741824
Jul 06 20:51:30 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-48d833e0-b73b-404a-8a19-acae10613192 tempest-VolumesDeleteCascade-1915974569 None] Create snapshot completed successfully
Jul 06 20:51:30 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.696s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:51:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d4d069ea-d713-4bc3-bd75-65c4d2e028af tempest-GroupSnapshotsTest-2030955167 None] Delete group completed successfully.
Jul 06 20:51:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 21847221-15d7-44b7-99a3-abaefd34afff: deleting
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 21847221-15d7-44b7-99a3-abaefd34afff: deleting {{(pid=86721) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-364926fb-33f7-421d-921c-36d747adefd1" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-364926fb-33f7-421d-921c-36d747adefd1" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-1229e64b-6c26-47fc-9deb-fcc8941e6698" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-1229e64b-6c26-47fc-9deb-fcc8941e6698" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Deleting offline snapshot 1229e64b-6c26-47fc-9deb-fcc8941e6698 of volume 364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] snapshot_file for this snap is: volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6300523-5b9b-41c2-8850-2a5a6c3104dd]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-b44664e8-b030-4b13-8029-9689d95ee085-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-b44664e8-b030-4b13-8029-9689d95ee085-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Performing cascade delete. {{(pid=86721) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-83b3bfaa-0409-4eab-bed2-70a61295a7ce-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:31 devstack sudo[93736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698
Jul 06 20:51:31 devstack sudo[93736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-83b3bfaa-0409-4eab-bed2-70a61295a7ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-83b3bfaa-0409-4eab-bed2-70a61295a7ce" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-83b3bfaa-0409-4eab-bed2-70a61295a7ce" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Deleting offline snapshot 83b3bfaa-0409-4eab-bed2-70a61295a7ce of volume b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] snapshot_file for this snap is: volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a584e6d9-0faa-41b4-ad10-252a4a168c76]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:31 devstack sudo[93741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce
Jul 06 20:51:31 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:31 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d 1073741824" returned: 0 in 0.916s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:31 devstack sudo[93744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d
Jul 06 20:51:31 devstack sudo[93744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:32 devstack sudo[93736]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698" returned: 0 in 0.985s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-364926fb-33f7-421d-921c-36d747adefd1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3ac577-f0ee-41ee-8c03-7c0bfb0684c0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:32 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce" returned: 0 in 0.830s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44664e8-b030-4b13-8029-9689d95ee085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:51:32 devstack sudo[93752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1
Jul 06 20:51:32 devstack sudo[93752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[988ead47-0612-40ba-bb77-f3241ed9ca76]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:32 devstack sudo[93744]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" returned: 0 in 0.703s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd0aa67-15b5-4eb7-bd82-64fd059ef4eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7e2164-8105-4e68-b528-fe0d6e8a9e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:32 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Volume volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d (1cde66ca-bacb-4ed7-93b9-7c04ea14312d): created successfully
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7e2164-8105-4e68-b528-fe0d6e8a9e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:32 devstack sudo[93755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba
Jul 06 20:51:32 devstack sudo[93755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Flow 'volume_create_manager' (59c0c95a-58b8-46ee-a750-6692ac26f01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8e2d7e99-4f1a-4719-a6f7-d92337a3a90a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Created volume successfully.
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Creating offline snapshot 0b115984-988a-4dc8-9188-e04bf0d9eb08 of volume 1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9857bc51-6b00-40b2-adac-bc79ebb23304]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:32 devstack sudo[93760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d
Jul 06 20:51:32 devstack sudo[93760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:32 devstack sudo[93752]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1" returned: 0 in 0.910s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:33 devstack sudo[93765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698
Jul 06 20:51:33 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:33 devstack sudo[93755]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba" returned: 0 in 0.852s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44664e8-b030-4b13-8029-9689d95ee085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:33 devstack sudo[93767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce
Jul 06 20:51:33 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:33 devstack sudo[93760]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" returned: 0 in 0.852s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:33 devstack sudo[93779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 1G
Jul 06 20:51:33 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:33 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698" returned: 0 in 0.893s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:33 devstack sudo[93782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698
Jul 06 20:51:33 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:33 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce" returned: 0 in 0.916s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:34 devstack sudo[93784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce
Jul 06 20:51:34 devstack sudo[93784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:34 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1.1229e64b-6c26-47fc-9deb-fcc8941e6698" returned: 0 in 0.846s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-1229e64b-6c26-47fc-9deb-fcc8941e6698" released by "_delete_snapshot" :: held 3.763s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:34 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-364926fb-33f7-421d-921c-36d747adefd1" released by "delete_snapshot" :: held 3.792s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 1G" returned: 0 in 1.079s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:34 devstack sudo[93792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08
Jul 06 20:51:34 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:34 devstack cinder-volume[86721]: WARNING cinder.quota [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1736335357 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1736335357, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:51:34 devstack sudo[93784]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.83b3bfaa-0409-4eab-bed2-70a61295a7ce" returned: 0 in 0.906s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-83b3bfaa-0409-4eab-bed2-70a61295a7ce" released by "_delete_snapshot" :: held 3.626s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['9a2cdc54-0e3f-4ab8-8b06-f78ad7248f7b', 'af5317c7-e525-438b-a3fb-321d30c7e405', '390c81db-b77f-41de-a026-8a7bd47c2af7', '6f641615-703e-426d-b818-c9460419e89e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" released by "delete_snapshot" :: held 3.660s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-aea492fa-b93a-4064-ab15-be54463f5dfb tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 21847221-15d7-44b7-99a3-abaefd34afff: deleted successfully
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Created reservations ['a93c4c90-adfd-4ba0-b57c-b609fc5be729', '2e207538-129f-45e8-9e23-f07429fca6b9', '5159b14a-5228-43e9-8651-443c9e5dfbb1', '6a974939-d3de-432b-b9e2-a410929cdc74'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Delete snapshot completed successfully.
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-83b3bfaa-0409-4eab-bed2-70a61295a7ce-delete_snapshot" released by "delete_snapshot" :: held 3.876s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-e5656235-6af6-4b6b-ac57-37de5a5510ba-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-e5656235-6af6-4b6b-ac57-37de5a5510ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-e5656235-6af6-4b6b-ac57-37de5a5510ba" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-e5656235-6af6-4b6b-ac57-37de5a5510ba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Deleting offline snapshot e5656235-6af6-4b6b-ac57-37de5a5510ba of volume b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] snapshot_file for this snap is: volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc658af-01b9-4c1c-b83e-8e1b16c4d99c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:35 devstack sudo[93796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba
Jul 06 20:51:35 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-364926fb-33f7-421d-921c-36d747adefd1" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-364926fb-33f7-421d-921c-36d747adefd1" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:35 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08" returned: 0 in 0.912s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:35 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 is being set with open permissions: ugo+rw
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4740d5-6b9e-44d0-8703-3dfc636443d3]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:35 devstack sudo[93802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08
Jul 06 20:51:35 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:35 devstack sudo[93803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1
Jul 06 20:51:35 devstack sudo[93803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:36 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba" returned: 0 in 0.908s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b44664e8-b030-4b13-8029-9689d95ee085(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b5ecad-5e10-4a24-bf44-839581d3b953]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:36 devstack sudo[93809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085
Jul 06 20:51:36 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:36 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=99,cinder:UPDATE=126,cinder:DELETE=12,cinder:INSERT=29 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=119,cinder:UPDATE=114,cinder:INSERT=23,cinder:DELETE=6 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:36 devstack sudo[93814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.info
Jul 06 20:51:36 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:36 devstack sudo[93803]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1" returned: 0 in 0.901s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:36 devstack sudo[93818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1
Jul 06 20:51:36 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:36 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-bf1c0ecb-956e-461f-88fd-b80db30497a4 req-1a9dc843-0b50-4167-ad25-2e64163e8e4e tempest-AttachVolumeTestJSON-1874748075 None] Terminate volume connection completed successfully.
Jul 06 20:51:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-bf1c0ecb-956e-461f-88fd-b80db30497a4 req-1a9dc843-0b50-4167-ad25-2e64163e8e4e tempest-AttachVolumeTestJSON-1874748075 None] Deleting attachment 41461319-7fea-4d8c-9c56-8a17e09600b2. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:51:37 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085" returned: 0 in 0.936s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:37 devstack sudo[93826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba
Jul 06 20:51:37 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:37 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.info" returned: 0 in 0.850s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:37 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.info is being set with open permissions: ugo+rw
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:37 devstack sudo[93830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.info
Jul 06 20:51:37 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:37 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-364926fb-33f7-421d-921c-36d747adefd1" returned: 0 in 0.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-364926fb-33f7-421d-921c-36d747adefd1" released by "delete_volume" :: held 1.780s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['b143692e-abfc-4456-b47c-d0f9825e5e5c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:37 devstack cinder-volume[86721]: WARNING cinder.db.api [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1736335357']
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['80583d2f-90a5-41c0-9d47-b0b5dd979dc5', 'b73d0bf5-7973-43d7-ac63-f8fe0dab360c', 'a2b405b9-792a-4902-a530-57bf6d0ac642', '230afa4d-f763-4390-b321-24fac3e33456'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:37 devstack sudo[93833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:51:37 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:37 devstack sudo[93838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:51:37 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:38 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba" returned: 0 in 1.030s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:38 devstack sudo[93842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba
Jul 06 20:51:38 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:38 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.info" returned: 0 in 0.991s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.492s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3b4471f3-6c11-4937-a9bc-1ef3fab6ed2e tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Create snapshot completed successfully
Jul 06 20:51:38 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.912s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:51:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-353351a1-2265-4af0-a33f-fb652aedbd12 tempest-GroupSnapshotsTest-2030955167 None] Group tempest-GroupSnapshotsTest-Group-1729196268: creating
Jul 06 20:51:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-353351a1-2265-4af0-a33f-fb652aedbd12 tempest-GroupSnapshotsTest-2030955167 None] Group tempest-GroupSnapshotsTest-Group-1729196268: created successfully
Jul 06 20:51:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-353351a1-2265-4af0-a33f-fb652aedbd12 tempest-GroupSnapshotsTest-2030955167 None] Create group completed successfully.
Jul 06 20:51:38 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.054s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:51:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ecea2d73-146e-4b46-961f-b6f0002bf40d tempest-GroupSnapshotsTest-2030955167 None] Delete group completed successfully.
Jul 06 20:51:39 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085.e5656235-6af6-4b6b-ac57-37de5a5510ba" returned: 0 in 0.860s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-e5656235-6af6-4b6b-ac57-37de5a5510ba" released by "_delete_snapshot" :: held 3.830s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" released by "delete_snapshot" :: held 3.857s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Created reservations ['080c3e6a-feb9-4678-8b4f-8b8978d254ad', '6b976aa7-c656-47a5-a293-1f81ccecc930', 'cac46dc0-d866-4802-b3f6-2f18381dab7c', 'f73b9b35-a87b-476f-9327-447531ea3efe'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:39 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Delete snapshot completed successfully.
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-e5656235-6af6-4b6b-ac57-37de5a5510ba-delete_snapshot" released by "delete_snapshot" :: held 4.016s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Snapshots deleted, issuing volume delete {{(pid=86721) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6271b3b3-86ad-4427-b48b-3ab953b78384]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:39 devstack sudo[93848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085
Jul 06 20:51:39 devstack sudo[93848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "cinder-0b115984-988a-4dc8-9188-e04bf0d9eb08-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-0b115984-988a-4dc8-9188-e04bf0d9eb08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "cinder-quobyte-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-quobyte-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "cinder-quobyte-0b115984-988a-4dc8-9188-e04bf0d9eb08" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-quobyte-0b115984-988a-4dc8-9188-e04bf0d9eb08" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Deleting offline snapshot 0b115984-988a-4dc8-9188-e04bf0d9eb08 of volume 1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] snapshot_file for this snap is: volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4764a722-9093-4221-88ff-7b134124980b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:39 devstack sudo[93854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08
Jul 06 20:51:39 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:40 devstack sudo[93848]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085" returned: 0 in 0.921s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:40 devstack sudo[93859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085
Jul 06 20:51:40 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (96d54bf2-1f39-447c-ac9e-05d74376c1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef9a28f-bc4d-4218-912a-8fe71e5a50e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fef9a28f-bc4d-4218-912a-8fe71e5a50e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266547353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20eebc17-5773-4e26-afa3-9198168c78f6,host='devstack@QuobyteHD#QuobyteHD',id=4ed7a83c-c16e-467c-92d5-357ad2eb22cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:40Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20494094-c0fd-4987-ae59-d0b80ab786e2),volume_type_id=20494094-c0fd-4987-ae59-d0b80ab786e2)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cb89a6-123b-4169-a30f-d5a4932055ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cb89a6-123b-4169-a30f-d5a4932055ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff58610-2118-4c4c-9e0a-353e1d0a787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff58610-2118-4c4c-9e0a-353e1d0a787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ed7a83c-c16e-467c-92d5-357ad2eb22cd', 'volume_name': 'volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229cd6ca-da69-4bb9-890f-3eff009f4c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (229cd6ca-da69-4bb9-890f-3eff009f4c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89aecf1-fb6a-4868-afb8-7fb140f0ec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:40 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Volume 4ed7a83c-c16e-467c-92d5-357ad2eb22cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd', 'volume_size': 1}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=20eebc17-5773-4e26-afa3-9198168c78f6,created_at=2026-07-06T18:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1266547353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20eebc17-5773-4e26-afa3-9198168c78f6,host='devstack@QuobyteHD#QuobyteHD',id=4ed7a83c-c16e-467c-92d5-357ad2eb22cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:40Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20494094-c0fd-4987-ae59-d0b80ab786e2),volume_type_id=20494094-c0fd-4987-ae59-d0b80ab786e2)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Creating volume 4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:40 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:40 devstack sudo[93863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd 1073741824
Jul 06 20:51:40 devstack sudo[93863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:40 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08" returned: 0 in 0.925s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e957f6-7da0-427c-a0f0-8126cc5464ec]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:40 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b44664e8-b030-4b13-8029-9689d95ee085" returned: 0 in 0.781s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:40 devstack sudo[93867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d
Jul 06 20:51:40 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-b44664e8-b030-4b13-8029-9689d95ee085" released by "delete_volume" :: held 1.784s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Created reservations ['06992d84-df0d-4106-a884-c96a731ffb14', 'd1f5d2aa-54e4-4543-82de-9cd717b7c3f5', 'f4c77853-4392-48c6-815a-d160daae1291', 'eda16cd6-c260-4fe5-b1bd-efc5c74d03b8'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:41 devstack sudo[93871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:51:41 devstack sudo[93871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:41 devstack sudo[93863]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd 1073741824" returned: 0 in 0.948s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:41 devstack sudo[93879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd
Jul 06 20:51:41 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:41 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" returned: 0 in 0.979s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:41 devstack sudo[93885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08
Jul 06 20:51:41 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:41 devstack sudo[93871]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.765s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:51:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Deleted volume successfully.
Jul 06 20:51:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbb4f828-20fa-4486-9ade-3add8e4436a1 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-b44664e8-b030-4b13-8029-9689d95ee085-delete_volume" released by "delete_volume" :: held 10.797s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:42 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" returned: 0 in 0.751s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] <== create_volume: return (1748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f89aecf1-fb6a-4868-afb8-7fb140f0ec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96b4c7-332d-496f-8f7b-6967d760870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:42 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Volume volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd (4ed7a83c-c16e-467c-92d5-357ad2eb22cd): created successfully
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e96b4c7-332d-496f-8f7b-6967d760870b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (96d54bf2-1f39-447c-ac9e-05d74376c1b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:42 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ab034e52-4eac-4cea-b248-2e1ff4068b4e tempest-GroupSnapshotsTest-2030955167 None] Created volume successfully.
Jul 06 20:51:42 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08" returned: 0 in 0.853s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:42 devstack sudo[93893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08
Jul 06 20:51:42 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Flow 'volume_create_manager' (a689e890-890a-412f-bb8f-20edfd72aee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eeacb1-1ab9-4efd-af16-5096bace723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2eeacb1-1ab9-4efd-af16-5096bace723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-338010997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9325c511-39f7-4c8f-9d41-83fc0b133c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c8179ae6034211b11b5cbe6c91e7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:43Z,use_quota=True,user_id='f7fb1adc4f3f4048a6b204e3ab3c493c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afe2095-14e8-4dc4-9c47-cce0f57289a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0afe2095-14e8-4dc4-9c47-cce0f57289a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c52cb35-ca28-41fa-84af-4009ef0e13d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c52cb35-ca28-41fa-84af-4009ef0e13d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9325c511-39f7-4c8f-9d41-83fc0b133c51', 'volume_name': 'volume-9325c511-39f7-4c8f-9d41-83fc0b133c51', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04480606-4f70-49fd-87a7-fcb407b1d74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04480606-4f70-49fd-87a7-fcb407b1d74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fda013-627d-4b8f-80e1-57093183c5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:42 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Volume 9325c511-39f7-4c8f-9d41-83fc0b133c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9325c511-39f7-4c8f-9d41-83fc0b133c51', 'volume_size': 1}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-338010997',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9325c511-39f7-4c8f-9d41-83fc0b133c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c8179ae6034211b11b5cbe6c91e7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:43Z,use_quota=True,user_id='f7fb1adc4f3f4048a6b204e3ab3c493c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Creating volume 9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:42 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:51:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:43 devstack sudo[93895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 1073741824
Jul 06 20:51:43 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:43 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d.0b115984-988a-4dc8-9188-e04bf0d9eb08" returned: 0 in 0.778s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-quobyte-0b115984-988a-4dc8-9188-e04bf0d9eb08" released by "_delete_snapshot" :: held 3.742s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-quobyte-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" released by "delete_snapshot" :: held 3.776s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (75b6677f-564b-40e4-a472-929a75060fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95165fe2-840d-458a-ac90-67d9ec860667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95165fe2-840d-458a-ac90-67d9ec860667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779631770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20eebc17-5773-4e26-afa3-9198168c78f6,host='devstack@QuobyteHD#QuobyteHD',id=a1ab316e-a659-4e45-abe6-cd290bcdf2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:44Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20494094-c0fd-4987-ae59-d0b80ab786e2),volume_type_id=20494094-c0fd-4987-ae59-d0b80ab786e2)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87864439-3631-43b3-8ce5-5bd82217364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87864439-3631-43b3-8ce5-5bd82217364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37681150-d9d2-44ba-92b9-d2f4a90a96c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37681150-d9d2-44ba-92b9-d2f4a90a96c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1ab316e-a659-4e45-abe6-cd290bcdf2dc', 'volume_name': 'volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d145c2b2-9ae5-4b31-9d4c-8fcc76bcb43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d145c2b2-9ae5-4b31-9d4c-8fcc76bcb43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b43e623-d9ea-4326-878e-48d00b026531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Volume a1ab316e-a659-4e45-abe6-cd290bcdf2dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc', 'volume_size': 1}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Created reservations ['0ade2f46-20f6-482d-a6b6-b1164abc156f', 'b6903a11-d2d8-44a1-9398-6f12f1f6be18', '153df902-0888-43b1-85c9-1db22e8a56d6', 'fef20470-87a8-4deb-94dd-9c53bead90c5'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Delete snapshot completed successfully.
Jul 06 20:51:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b1a63e9c-9a99-4362-bf50-44ebcf7f1180 tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-0b115984-988a-4dc8-9188-e04bf0d9eb08-delete_snapshot" released by "delete_snapshot" :: held 4.062s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "cinder-1cde66ca-bacb-4ed7-93b9-7c04ea14312d-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-1cde66ca-bacb-4ed7-93b9-7c04ea14312d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "cinder-quobyte-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:51:44 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 1073741824" returned: 0 in 1.140s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-quobyte-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6850a-735b-4834-8af3-73bd1b4506d7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:44 devstack sudo[93903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51
Jul 06 20:51:44 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:44 devstack sudo[93902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d
Jul 06 20:51:44 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:44 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51" returned: 0 in 0.637s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.182s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=20eebc17-5773-4e26-afa3-9198168c78f6,created_at=2026-07-06T18:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1779631770',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20eebc17-5773-4e26-afa3-9198168c78f6,host='devstack@QuobyteHD#QuobyteHD',id=a1ab316e-a659-4e45-abe6-cd290bcdf2dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:44Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(20494094-c0fd-4987-ae59-d0b80ab786e2),volume_type_id=20494094-c0fd-4987-ae59-d0b80ab786e2)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Creating volume a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:51:44 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:44 devstack sudo[93910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc 1073741824
Jul 06 20:51:44 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45fda013-627d-4b8f-80e1-57093183c5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9325c511-39f7-4c8f-9d41-83fc0b133c51', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a627dbf-2b03-4399-b49a-c976ad7db844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:44 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Volume volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 (9325c511-39f7-4c8f-9d41-83fc0b133c51): created successfully
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a627dbf-2b03-4399-b49a-c976ad7db844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Flow 'volume_create_manager' (a689e890-890a-412f-bb8f-20edfd72aee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:44 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1602cb9e-0228-4bce-898e-7d208491f058 tempest-VolumesDeleteCascade-1915974569 None] Created volume successfully.
Jul 06 20:51:44 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" returned: 0 in 0.794s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:45 devstack sudo[93912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d
Jul 06 20:51:45 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:45 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" returned: 0 in 0.699s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:45 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-quobyte-1cde66ca-bacb-4ed7-93b9-7c04ea14312d" released by "delete_volume" :: held 1.553s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc 1073741824" returned: 0 in 0.843s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:45 devstack sudo[93919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc
Jul 06 20:51:45 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Created reservations ['1f74ea90-3897-4923-aed0-1520c0405c95', 'e3f647b5-0ba0-4878-8c6c-01f682c7daa8', '0bfa41e2-590d-4427-b6f8-fef838f79cad', '24f475e8-a651-4d7f-b6a1-9e3d530c4807'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:45 devstack sudo[93921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:51:45 devstack sudo[93921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:46 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" returned: 0 in 0.710s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.262s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b43e623-d9ea-4326-878e-48d00b026531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7760f0-7d30-4d28-9a25-0aba98616607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Creating offline snapshot 7360f003-babc-400c-8cb3-6c88be309435 of volume 9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:51:46 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Volume volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc (a1ab316e-a659-4e45-abe6-cd290bcdf2dc): created successfully
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e7760f0-7d30-4d28-9a25-0aba98616607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (75b6677f-564b-40e4-a472-929a75060fd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6988fc0c-2687-4445-aade-1a4aaae1f2b9]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3c1bb8f2-9d22-4227-ab35-401b3e51ee0c tempest-GroupSnapshotsTest-2030955167 None] Created volume successfully.
Jul 06 20:51:46 devstack sudo[93921]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.853s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:51:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Deleted volume successfully.
Jul 06 20:51:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1e6e189-98c8-4512-a136-bd3de0944c9a tempest-VolumeSnapshotQuotasNegativeTestJSON-1304350230 None] Lock "cinder-1cde66ca-bacb-4ed7-93b9-7c04ea14312d-delete_volume" released by "delete_volume" :: held 2.675s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:51:46 devstack sudo[93932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51
Jul 06 20:51:46 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1e1e3d66-892f-4a4b-baf8-b953d29e9723 tempest-GroupSnapshotsTest-2030955167 None] Update group completed successfully.
Jul 06 20:51:47 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51" returned: 0 in 1.078s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:47 devstack sudo[93948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 1G
Jul 06 20:51:47 devstack sudo[93948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-85464e62-69c2-4307-8855-df09fccc56f0 tempest-GroupSnapshotsTest-2030955167 None] Update group completed successfully.
Jul 06 20:51:48 devstack sudo[93948]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 1G" returned: 0 in 0.988s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:48 devstack sudo[93961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435
Jul 06 20:51:48 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:49 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435" returned: 0 in 0.798s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:49 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 is being set with open permissions: ugo+rw
Jul 06 20:51:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:49 devstack sudo[93977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435
Jul 06 20:51:49 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fc660a8a-9fb5-4b9d-a992-879707fa9185 tempest-GroupSnapshotsTest-2030955167 None] Update group completed successfully.
Jul 06 20:51:50 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435" returned: 0 in 1.302s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:50 devstack sudo[94039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.info
Jul 06 20:51:50 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-838e1a56-07f0-47eb-b775-00bed328171b tempest-GroupSnapshotsTest-2030955167 None] Update group completed successfully.
Jul 06 20:51:51 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.info" returned: 0 in 0.797s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:51 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.info is being set with open permissions: ugo+rw
Jul 06 20:51:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:51 devstack sudo[94044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.info
Jul 06 20:51:51 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:52 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.info" returned: 0 in 0.870s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.035s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1ee73548-430f-4490-9fd3-81c7d2015a45 tempest-VolumesDeleteCascade-1915974569 None] Create snapshot completed successfully
Jul 06 20:51:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] GroupSnapshot b6ad72a5-6645-4119-bd4a-778af46f08b9: creating.
Jul 06 20:51:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Group snapshot b6ad72a5-6645-4119-bd4a-778af46f08b9: creating. {{(pid=86721) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 20:51:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Creating offline snapshot 0b349f76-df40-426b-bc53-e1b5d2a1955f of volume 4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:51:53 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f4b4ca-7cf1-46d5-b801-9904ed0d8568]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:53 devstack sudo[94048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd
Jul 06 20:51:53 devstack sudo[94048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:54 devstack sudo[94048]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" returned: 0 in 1.134s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:54 devstack sudo[94053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f 1G
Jul 06 20:51:54 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Flow 'volume_create_manager' (d5ca7185-649f-4e2e-93a5-85ff08e4d6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a18190-5d51-4dea-8d43-0632a36329d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a18190-5d51-4dea-8d43-0632a36329d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1813212962',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5439d679-f90b-4bbd-af26-f24ec10df793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57c8179ae6034211b11b5cbe6c91e7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7360f003-babc-400c-8cb3-6c88be309435,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:54Z,use_quota=True,user_id='f7fb1adc4f3f4048a6b204e3ab3c493c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a939d1e1-3d46-4824-8638-0231ff4b4c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a939d1e1-3d46-4824-8638-0231ff4b4c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd605ce2-03e9-46f4-b8d6-951d548701eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd605ce2-03e9-46f4-b8d6-951d548701eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5439d679-f90b-4bbd-af26-f24ec10df793', 'volume_name': 'volume-5439d679-f90b-4bbd-af26-f24ec10df793', 'volume_size': 1, 'snapshot_id': '7360f003-babc-400c-8cb3-6c88be309435'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc267956-3380-4105-9205-805deab51d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc267956-3380-4105-9205-805deab51d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bbd65c-d02e-4171-a156-1feb53992d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:54 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Volume 5439d679-f90b-4bbd-af26-f24ec10df793: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5439d679-f90b-4bbd-af26-f24ec10df793', 'volume_size': 1, 'snapshot_id': '7360f003-babc-400c-8cb3-6c88be309435'}
Jul 06 20:51:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:55 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f 1G" returned: 0 in 1.054s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:55 devstack sudo[94059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f
Jul 06 20:51:55 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:56 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f" returned: 0 in 0.719s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:56 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:51:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:56 devstack sudo[94064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f
Jul 06 20:51:56 devstack sudo[94064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:56 devstack sudo[94064]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f" returned: 0 in 0.673s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:56 devstack sudo[94068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.info
Jul 06 20:51:56 devstack sudo[94068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:57 devstack sudo[94068]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.info" returned: 0 in 0.730s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:57 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:51:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:57 devstack sudo[94072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.info
Jul 06 20:51:57 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Flow 'volume_create_manager' (e3962b21-2371-4c03-8263-4e2ac0406903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c4d6aa-4ce8-4fc4-a6c8-9a118ab74968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:58 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1c4d6aa-4ce8-4fc4-a6c8-9a118ab74968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1167766752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aff8a23-908b-4613-b220-713cf305dae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ae497a750640fbb41f01717918585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:58Z,use_quota=True,user_id='ea09dc7ba230439a95e32d78c616a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ddcbb6-e29a-4adc-9c11-033d7c92a277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64ddcbb6-e29a-4adc-9c11-033d7c92a277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80190f83-2ebc-4403-a601-d4ebfad77a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80190f83-2ebc-4403-a601-d4ebfad77a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6aff8a23-908b-4613-b220-713cf305dae9', 'volume_name': 'volume-6aff8a23-908b-4613-b220-713cf305dae9', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c64eaf2-b98b-4da0-8a95-c9e905abcf96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c64eaf2-b98b-4da0-8a95-c9e905abcf96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bae6cb9-f1e8-411e-a159-c1e6e67ac0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:51:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Volume 6aff8a23-908b-4613-b220-713cf305dae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6aff8a23-908b-4613-b220-713cf305dae9', 'volume_size': 1}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.info" returned: 0 in 0.780s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.204s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Creating offline snapshot 547a219d-b2a3-4a66-88e8-651ce11ce7c2 of volume a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e3f44a-33d1-455c-a380-9f54e6820670]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:51:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:58 devstack sudo[94075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc
Jul 06 20:51:58 devstack sudo[94075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:59 devstack sudo[94075]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" returned: 0 in 0.728s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:59 devstack sudo[94080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 1G
Jul 06 20:51:59 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:51:59 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root
Jul 06 20:51:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 1G" returned: 0 in 0.792s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:51:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:51:59 devstack sudo[94085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2
Jul 06 20:51:59 devstack sudo[94085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:00 devstack sudo[94085]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2" returned: 0 in 0.685s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:00 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:52:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:00 devstack sudo[94090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2
Jul 06 20:52:00 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:01 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2" returned: 0 in 0.636s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:01 devstack sudo[94093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.info
Jul 06 20:52:01 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:01 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.info" returned: 0 in 0.681s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:01 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:52:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:01 devstack sudo[94096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.info
Jul 06 20:52:01 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:02 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.info" returned: 0 in 0.717s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.329s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.351s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1167766752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aff8a23-908b-4613-b220-713cf305dae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93ae497a750640fbb41f01717918585b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:51:58Z,use_quota=True,user_id='ea09dc7ba230439a95e32d78c616a87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Creating volume 6aff8a23-908b-4613-b220-713cf305dae9 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:02 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:02 devstack sudo[94135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9 1073741824
Jul 06 20:52:02 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:02 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d44af99f-99da-4475-9873-9d0178764e0c tempest-GroupSnapshotsTest-2030955167 None] group_snapshot b6ad72a5-6645-4119-bd4a-778af46f08b9: created successfully
Jul 06 20:52:03 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9 1073741824" returned: 0 in 0.930s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:03 devstack sudo[94150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9
Jul 06 20:52:03 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] group_snapshot b6ad72a5-6645-4119-bd4a-778af46f08b9: deleting
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] group_snapshot b6ad72a5-6645-4119-bd4a-778af46f08b9: deleting {{(pid=86721) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-0b349f76-df40-426b-bc53-e1b5d2a1955f" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-0b349f76-df40-426b-bc53-e1b5d2a1955f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Deleting offline snapshot 0b349f76-df40-426b-bc53-e1b5d2a1955f of volume 4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] snapshot_file for this snap is: volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e6026-bc7d-4abc-807d-4addf6cb3264]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:04 devstack sudo[94152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f
Jul 06 20:52:04 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:04 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9" returned: 0 in 0.677s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.732s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-7360f003-babc-400c-8cb3-6c88be309435-5439d679-f90b-4bbd-af26-f24ec10df793" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bae6cb9-f1e8-411e-a159-c1e6e67ac0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aff8a23-908b-4613-b220-713cf305dae9', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4e931b-002e-4541-8071-bae2bd9e99d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:04 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Volume volume-6aff8a23-908b-4613-b220-713cf305dae9 (6aff8a23-908b-4613-b220-713cf305dae9): created successfully
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4e931b-002e-4541-8071-bae2bd9e99d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Flow 'volume_create_manager' (e3962b21-2371-4c03-8263-4e2ac0406903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-7360f003-babc-400c-8cb3-6c88be309435-5439d679-f90b-4bbd-af26-f24ec10df793" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Creating volume 5439d679-f90b-4bbd-af26-f24ec10df793 from snapshot 7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-5439d679-f90b-4bbd-af26-f24ec10df793" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:04 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3b893f2c-404c-4dc3-85db-0a03b83e1b28 tempest-VolumesMetadataTest-1598931816 None] Created volume successfully.
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-5439d679-f90b-4bbd-af26-f24ec10df793" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] snapshot: 7360f003-babc-400c-8cb3-6c88be309435, volume: 5439d679-f90b-4bbd-af26-f24ec10df793,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[24921149-818a-4442-be24-9141b811bb8c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:04 devstack sudo[94155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435
Jul 06 20:52:04 devstack sudo[94155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:04 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f" returned: 0 in 0.848s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64c8485-e1cf-4550-9f7f-dfe1dfe61d2e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:05 devstack sudo[94160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd
Jul 06 20:52:05 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:05 devstack sudo[94155]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435" returned: 0 in 0.865s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9325c511-39f7-4c8f-9d41-83fc0b133c51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea6a453-6bd5-4b90-8321-baa950878aa7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Acquiring lock "cinder-6aff8a23-908b-4613-b220-713cf305dae9-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Lock "cinder-6aff8a23-908b-4613-b220-713cf305dae9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Acquiring lock "cinder-quobyte-6aff8a23-908b-4613-b220-713cf305dae9" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Lock "cinder-quobyte-6aff8a23-908b-4613-b220-713cf305dae9" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:05 devstack sudo[94166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51
Jul 06 20:52:05 devstack sudo[94166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b703ac5-f97d-4ef5-9cca-68f1169e0f56]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:05 devstack sudo[94168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9
Jul 06 20:52:05 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:05 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" returned: 0 in 0.868s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:05 devstack sudo[94173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f
Jul 06 20:52:05 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:06 devstack sudo[94166]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51" returned: 0 in 0.890s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:06 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:52:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:06 devstack sudo[94181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793
Jul 06 20:52:06 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:06 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9" returned: 0 in 0.900s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:06 devstack sudo[94186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9
Jul 06 20:52:06 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:06 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f" returned: 0 in 0.761s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:06 devstack sudo[94188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f
Jul 06 20:52:06 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:07 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6aff8a23-908b-4613-b220-713cf305dae9" returned: 0 in 0.842s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Lock "cinder-quobyte-6aff8a23-908b-4613-b220-713cf305dae9" released by "delete_volume" :: held 1.831s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:07 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd.0b349f76-df40-426b-bc53-e1b5d2a1955f" returned: 0 in 0.886s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-0b349f76-df40-426b-bc53-e1b5d2a1955f" released by "_delete_snapshot" :: held 3.554s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" released by "delete_snapshot" :: held 3.595s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Created reservations ['4473501f-fb19-4fea-94a6-5dad3a0748ef', 'd870df22-cec5-4a89-a877-1572aa78454c', '348f3ae2-4aff-4de8-b994-4f3b7ca3b6be', '823ac477-fe5f-4c9e-b2ff-1cc58608eee5'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-547a219d-b2a3-4a66-88e8-651ce11ce7c2" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-547a219d-b2a3-4a66-88e8-651ce11ce7c2" acquired by "_delete_snapshot" :: waited 0.102s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Deleting offline snapshot 547a219d-b2a3-4a66-88e8-651ce11ce7c2 of volume a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] snapshot_file for this snap is: volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0361b4bf-55f3-4e92-97a8-9d8e83639295]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:07 devstack sudo[94205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:07 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:08 devstack sudo[94204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2
Jul 06 20:52:08 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:09 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.944s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:09 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:09 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2" returned: 0 in 2.113s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:52:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Deleted volume successfully.
Jul 06 20:52:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[33958ee2-96be-4ba0-b338-45099d04b6d1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-491dd9c4-42c0-49db-a407-8986a89822c9 tempest-VolumesMetadataTest-1598931816 None] Lock "cinder-6aff8a23-908b-4613-b220-713cf305dae9-delete_volume" released by "delete_volume" :: held 4.596s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:10 devstack sudo[94212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc
Jul 06 20:52:10 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:11 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" returned: 0 in 1.702s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:11 devstack sudo[94217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2
Jul 06 20:52:11 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:12 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793" returned: 0 in 6.149s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:12 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[63305ed9-718b-4431-935f-9532609fa01c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:12 devstack sudo[94220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51
Jul 06 20:52:12 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:12 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2" returned: 0 in 1.173s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:12 devstack sudo[94225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2
Jul 06 20:52:12 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:13 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51" returned: 0 in 1.228s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:13 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:52:13 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Converted 1024.00 MB image at 166.49 MB/s
Jul 06 20:52:13 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793 is being set with open permissions: ugo+rw
Jul 06 20:52:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:13 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc.547a219d-b2a3-4a66-88e8-651ce11ce7c2" returned: 0 in 0.840s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:13 devstack sudo[94240]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793
Jul 06 20:52:13 devstack sudo[94240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-547a219d-b2a3-4a66-88e8-651ce11ce7c2" released by "_delete_snapshot" :: held 6.059s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" released by "delete_snapshot" :: held 6.172s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:13 devstack cinder-volume[86721]: WARNING cinder.quota [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-111406456 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-111406456, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:52:13 devstack cinder-volume[86721]: WARNING cinder.quota [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-111406456 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-111406456, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:52:13 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['42bd84c7-64f6-48c3-a765-723441da78a6', 'eb390282-0a7f-413a-bf2e-0dd6e16eceaa', '76c0f905-b03f-4ef3-a0a2-3ff2bc216701', '88bb9ae5-a261-4b0d-81c0-f7ff354527fe'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['152ffe51-21f3-4017-b7cb-979ea939c574', '42f54351-9aa8-4a1c-97d2-e887ec075185', '1c1647f1-9efb-4226-9927-346d7efca384', 'f9ebb706-de3f-4ab7-a4ca-f8bc0ad34478'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:14 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1aa19bdb-27a9-4193-a9f0-1934a80d9396 tempest-GroupSnapshotsTest-2030955167 None] group_snapshot b6ad72a5-6645-4119-bd4a-778af46f08b9: deleted successfully
Jul 06 20:52:14 devstack sudo[94240]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793" returned: 0 in 0.868s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-5439d679-f90b-4bbd-af26-f24ec10df793" released by "_copy_volume_from_snapshot" :: held 10.118s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-7360f003-babc-400c-8cb3-6c88be309435-5439d679-f90b-4bbd-af26-f24ec10df793" released by "_create_volume_from_snapshot" :: held 10.165s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.217s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64bbd65c-d02e-4171-a156-1feb53992d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5439d679-f90b-4bbd-af26-f24ec10df793', 'volume_size': 1, 'snapshot_id': '7360f003-babc-400c-8cb3-6c88be309435'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0426267f-b3cd-489e-b1c6-fd15f1ebfeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:14 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Volume volume-5439d679-f90b-4bbd-af26-f24ec10df793 (5439d679-f90b-4bbd-af26-f24ec10df793): created successfully
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0426267f-b3cd-489e-b1c6-fd15f1ebfeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Flow 'volume_create_manager' (d5ca7185-649f-4e2e-93a5-85ff08e4d6a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:14 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e434b6d5-907d-497a-9469-729af4e5ad7c tempest-VolumesDeleteCascade-1915974569 None] Created volume successfully.
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Flow 'volume_create_manager' (e08daa08-abf1-439c-afd1-671e6083ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7d9cf-ca6e-436e-9d05-ca66294e6371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ae7d9cf-ca6e-436e-9d05-ca66294e6371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-583355110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357190e8-e0f2-4e82-a5b0-4efc24278748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e521a60ff01467d917b38936a48612f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:15Z,use_quota=True,user_id='c0557671198349aabb166d0f10244f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9e25cd-6d84-4a52-88f5-4d7f677e1fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9e25cd-6d84-4a52-88f5-4d7f677e1fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b34e44-606b-49f8-8a82-74b8874e1a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b34e44-606b-49f8-8a82-74b8874e1a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357190e8-e0f2-4e82-a5b0-4efc24278748', 'volume_name': 'volume-357190e8-e0f2-4e82-a5b0-4efc24278748', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bac8970-359c-4697-b169-7f351cb627f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bac8970-359c-4697-b169-7f351cb627f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133b3d10-15ac-4c46-9f62-a669d68374fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:14 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Volume 357190e8-e0f2-4e82-a5b0-4efc24278748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357190e8-e0f2-4e82-a5b0-4efc24278748', 'volume_size': 1}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-583355110',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=357190e8-e0f2-4e82-a5b0-4efc24278748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e521a60ff01467d917b38936a48612f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:15Z,use_quota=True,user_id='c0557671198349aabb166d0f10244f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Creating volume 357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:14 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:14 devstack sudo[94249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 1073741824
Jul 06 20:52:14 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1344f4fc-3ca9-43c5-b33f-47d7a7f75f0f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-9325c511-39f7-4c8f-9d41-83fc0b133c51-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-9325c511-39f7-4c8f-9d41-83fc0b133c51-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:15 devstack sudo[94269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd
Jul 06 20:52:15 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Performing cascade delete. {{(pid=86721) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-7360f003-babc-400c-8cb3-6c88be309435-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-7360f003-babc-400c-8cb3-6c88be309435-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-9325c511-39f7-4c8f-9d41-83fc0b133c51" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-9325c511-39f7-4c8f-9d41-83fc0b133c51" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-7360f003-babc-400c-8cb3-6c88be309435" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-7360f003-babc-400c-8cb3-6c88be309435" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Deleting offline snapshot 7360f003-babc-400c-8cb3-6c88be309435 of volume 9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] snapshot_file for this snap is: volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[380c2491-dfaa-4f21-a460-745bb7f97b17]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:16 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 1073741824" returned: 0 in 1.244s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:16 devstack sudo[94272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435
Jul 06 20:52:16 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:16 devstack sudo[94274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748
Jul 06 20:52:16 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:16 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" returned: 0 in 1.205s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:17 devstack sudo[94284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd
Jul 06 20:52:17 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:17 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435" returned: 0 in 1.088s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9325c511-39f7-4c8f-9d41-83fc0b133c51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[78992dbf-48f6-4c00-a33f-5b21c1b48071]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:17 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748" returned: 0 in 1.018s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] <== create_volume: return (2358ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133b3d10-15ac-4c46-9f62-a669d68374fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357190e8-e0f2-4e82-a5b0-4efc24278748', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2290af-fa97-444a-9370-a358ae31342f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:17 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Volume volume-357190e8-e0f2-4e82-a5b0-4efc24278748 (357190e8-e0f2-4e82-a5b0-4efc24278748): created successfully
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd2290af-fa97-444a-9370-a358ae31342f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Flow 'volume_create_manager' (e08daa08-abf1-439c-afd1-671e6083ace4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:17 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-60bf3a81-a1b5-43ad-935c-b31f1cacbc0b tempest-VolumesCloneTest-1307021463 None] Created volume successfully.
Jul 06 20:52:17 devstack sudo[94289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51
Jul 06 20:52:17 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:17 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" returned: 0 in 0.951s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-4ed7a83c-c16e-467c-92d5-357ad2eb22cd" released by "delete_volume" :: held 2.275s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb1407a-d95a-40cf-ac83-05577f92905b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:18 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51" returned: 0 in 0.840s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:18 devstack sudo[94296]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc
Jul 06 20:52:18 devstack sudo[94296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:18 devstack sudo[94297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435
Jul 06 20:52:18 devstack sudo[94297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:18 devstack sudo[94296]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" returned: 0 in 0.876s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:18 devstack sudo[94306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc
Jul 06 20:52:18 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Flow 'volume_create_manager' (5b3d47ff-10e0-41c4-b207-d68b3bc42d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567a79ee-4e03-43ca-8ba9-37acedb7cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (567a79ee-4e03-43ca-8ba9-37acedb7cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-305182535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf475600-7f12-4403-b7ca-165de5f5d542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e521a60ff01467d917b38936a48612f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=357190e8-e0f2-4e82-a5b0-4efc24278748,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:19Z,use_quota=True,user_id='c0557671198349aabb166d0f10244f94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14055740-4783-4630-ba2f-e7d006c5a112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14055740-4783-4630-ba2f-e7d006c5a112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29674b9-e055-4bf7-814e-4c3c4c85dc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e29674b9-e055-4bf7-814e-4c3c4c85dc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cf475600-7f12-4403-b7ca-165de5f5d542', 'volume_name': 'volume-cf475600-7f12-4403-b7ca-165de5f5d542', 'volume_size': 2, 'source_volid': '357190e8-e0f2-4e82-a5b0-4efc24278748', 'source_volstatus': 'available'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d77f55d-f7b7-4660-9b50-0f33de11a4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d77f55d-f7b7-4660-9b50-0f33de11a4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da328f0-a7ce-415b-98ad-e0775ed4aea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:18 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Volume cf475600-7f12-4403-b7ca-165de5f5d542: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cf475600-7f12-4403-b7ca-165de5f5d542', 'volume_size': 2, 'source_volid': '357190e8-e0f2-4e82-a5b0-4efc24278748', 'source_volstatus': 'available'}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:19 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Cloning volume 357190e8-e0f2-4e82-a5b0-4efc24278748 to volume cf475600-7f12-4403-b7ca-165de5f5d542
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Creating offline snapshot a0f1d032-f941-4997-8393-edf7726d8deb of volume 357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:52:19 devstack sudo[94297]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435" returned: 0 in 0.967s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e98160-a727-41f3-a4ee-cbe22bfd169a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:19 devstack sudo[94308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435
Jul 06 20:52:19 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:19 devstack sudo[94309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748
Jul 06 20:52:19 devstack sudo[94309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:19 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" returned: 0 in 0.743s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-a1ab316e-a659-4e45-abe6-cd290bcdf2dc" released by "delete_volume" :: held 1.685s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['4b135367-38b2-438f-8851-e8d5ce4ee720'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:19 devstack cinder-volume[86721]: WARNING cinder.quota [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-111406456 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-111406456, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['7e63fc99-4fae-4985-9f8e-f3bae329ea48', '1a6d7db5-588f-4297-9e3a-00bae4b0bb56', 'c31dfdc1-08ed-4ac8-b861-f1f8ec3064e5', '5d40ee45-4945-4dc3-9da8-d206fd70940f'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:19 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51.7360f003-babc-400c-8cb3-6c88be309435" returned: 0 in 0.762s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-7360f003-babc-400c-8cb3-6c88be309435" released by "_delete_snapshot" :: held 3.796s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-9325c511-39f7-4c8f-9d41-83fc0b133c51" released by "delete_snapshot" :: held 3.842s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:19 devstack sudo[94309]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748" returned: 0 in 0.818s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:19 devstack sudo[94317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb 1G
Jul 06 20:52:19 devstack sudo[94317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Created reservations ['328bd855-f69a-4099-ba23-a52575d6982e', '5f21b36b-5eb5-4bef-b51d-bc9161ef34f5', 'b984e055-f2de-4e78-872e-25ea63b3ed46', 'e71818ed-2259-42e2-9e3f-7b9ff1f9b3df'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['6af27b38-1213-49e8-b13b-27f3514531dd', '807f25d1-50cc-4d6f-89a4-27907d373c75', '48ebdd20-2196-428f-b9e6-2f3d161e99e5', 'b1b44c2d-75d9-45b3-b6bd-81c1ba189bb1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Delete snapshot completed successfully.
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-7360f003-babc-400c-8cb3-6c88be309435-delete_snapshot" released by "delete_snapshot" :: held 4.088s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Snapshots deleted, issuing volume delete {{(pid=86721) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-9325c511-39f7-4c8f-9d41-83fc0b133c51" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-9325c511-39f7-4c8f-9d41-83fc0b133c51" acquired by "delete_volume" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de83ea61-e81f-49fb-a5e0-417c1811f829]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:20 devstack sudo[94325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:20 devstack sudo[94325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:20 devstack sudo[94326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51
Jul 06 20:52:20 devstack sudo[94326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:20 devstack sudo[94317]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb 1G" returned: 0 in 0.965s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-357190e8-e0f2-4e82-a5b0-4efc24278748 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:20 devstack sudo[94334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-357190e8-e0f2-4e82-a5b0-4efc24278748 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb
Jul 06 20:52:20 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:20 devstack sudo[94325]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.786s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:20 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1f41b3cb-8f7e-4f9a-9cec-ffad218bd8d1 tempest-GroupSnapshotsTest-2030955167 None] Delete group completed successfully.
Jul 06 20:52:21 devstack sudo[94326]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51" returned: 0 in 0.952s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:21 devstack sudo[94339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51
Jul 06 20:52:21 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8a077807-db85-4b81-88c6-58c599c1c39c tempest-GroupSnapshotsTest-2030955167 None] Group tempest-GroupSnapshotsTest-Group-2032124735: creating
Jul 06 20:52:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8a077807-db85-4b81-88c6-58c599c1c39c tempest-GroupSnapshotsTest-2030955167 None] Group tempest-GroupSnapshotsTest-Group-2032124735: created successfully
Jul 06 20:52:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8a077807-db85-4b81-88c6-58c599c1c39c tempest-GroupSnapshotsTest-2030955167 None] Create group completed successfully.
Jul 06 20:52:21 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-357190e8-e0f2-4e82-a5b0-4efc24278748 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb" returned: 0 in 0.899s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:21 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb is being set with open permissions: ugo+rw
Jul 06 20:52:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:21 devstack sudo[94345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb
Jul 06 20:52:21 devstack sudo[94345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:21 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9325c511-39f7-4c8f-9d41-83fc0b133c51" returned: 0 in 0.834s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-9325c511-39f7-4c8f-9d41-83fc0b133c51" released by "delete_volume" :: held 1.881s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Created reservations ['a7f8a7ae-8b5b-405c-9f63-ba00860fc52e', '06bf9531-7283-4fa8-91c2-f4f0c29133dc', '7691949b-102e-4059-9914-89a137e773b0', '18e4ad64-7254-4420-bb67-147201fe1eb9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:22 devstack sudo[94348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:22 devstack sudo[94348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:22 devstack sudo[94345]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:22 devstack sudo[94351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.info
Jul 06 20:52:22 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-5439d679-f90b-4bbd-af26-f24ec10df793-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-5439d679-f90b-4bbd-af26-f24ec10df793-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "cinder-quobyte-5439d679-f90b-4bbd-af26-f24ec10df793" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-5439d679-f90b-4bbd-af26-f24ec10df793" acquired by "delete_volume" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:23 devstack sudo[94348]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.984s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Deleted volume successfully.
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[efea1d07-ee65-46ca-8e1f-79a53e4e7209]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-05c39e56-ea54-4d40-994b-ccdb525b7ecc tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-9325c511-39f7-4c8f-9d41-83fc0b133c51-delete_volume" released by "delete_volume" :: held 7.341s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (da6a69bf-907d-49ef-bc70-6d85f3923d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8891b3b8-2579-4954-b2f4-80c07cff3540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:23 devstack sudo[94354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793
Jul 06 20:52:23 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8891b3b8-2579-4954-b2f4-80c07cff3540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981030479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7f0d7e5d-5cce-41b3-bfcc-6054aa8b5ce5,host='devstack@QuobyteHD#QuobyteHD',id=5b605709-3c58-4c7a-b14f-13084f790863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:23Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d64ef26-141b-4207-be07-8123c6b82f12),volume_type_id=9d64ef26-141b-4207-be07-8123c6b82f12)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28793dca-05e7-4e02-ad0e-c2ac123d351e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28793dca-05e7-4e02-ad0e-c2ac123d351e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857efab1-8b88-48ab-a143-e81cebe64647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (857efab1-8b88-48ab-a143-e81cebe64647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b605709-3c58-4c7a-b14f-13084f790863', 'volume_name': 'volume-5b605709-3c58-4c7a-b14f-13084f790863', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d03720-ae75-4f2a-9620-3c52ca7d9603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09d03720-ae75-4f2a-9620-3c52ca7d9603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fc233b-4922-4148-86a4-1e760f32459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Volume 5b605709-3c58-4c7a-b14f-13084f790863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b605709-3c58-4c7a-b14f-13084f790863', 'volume_size': 1}
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:23 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.info" returned: 0 in 1.009s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:23 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.info is being set with open permissions: ugo+rw
Jul 06 20:52:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:23 devstack sudo[94357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.info
Jul 06 20:52:23 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:24 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793" returned: 0 in 0.902s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:24 devstack sudo[94362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793
Jul 06 20:52:24 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:24 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.info" returned: 0 in 0.740s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Acquiring lock "cinder-quobyte-cf475600-7f12-4403-b7ca-165de5f5d542" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-cf475600-7f12-4403-b7ca-165de5f5d542" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] snapshot: a0f1d032-f941-4997-8393-edf7726d8deb, volume: cf475600-7f12-4403-b7ca-165de5f5d542,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4338ab24-65ea-4f3d-98fe-07be66472f1d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:24 devstack sudo[94365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb
Jul 06 20:52:24 devstack sudo[94365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:24 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5439d679-f90b-4bbd-af26-f24ec10df793" returned: 0 in 0.789s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-quobyte-5439d679-f90b-4bbd-af26-f24ec10df793" released by "delete_volume" :: held 1.779s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:24 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Created reservations ['954fa382-4d11-41a1-b7d5-4bb92b140856', '4a9ac89e-8994-40a7-a781-aeede7e44d97', '33e02d90-4e19-4b5c-b635-1dc171552570', 'c4de10eb-fa7b-4ffd-8080-de92688f04db'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:25 devstack sudo[94368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:25 devstack sudo[94368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:25 devstack sudo[94365]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb" returned: 0 in 0.953s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-357190e8-e0f2-4e82-a5b0-4efc24278748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a6bd01-c2b8-4c6d-b584-dab5caaa99fc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:25 devstack sudo[94373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748
Jul 06 20:52:25 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:25 devstack sudo[94368]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.836s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Deleted volume successfully.
Jul 06 20:52:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9dc8eec2-f5f6-40e3-8617-2edc6628a347 tempest-VolumesDeleteCascade-1915974569 None] Lock "cinder-5439d679-f90b-4bbd-af26-f24ec10df793-delete_volume" released by "delete_volume" :: held 2.938s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:26 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748" returned: 0 in 1.078s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:26 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:52:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:26 devstack sudo[94382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542
Jul 06 20:52:26 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:32 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542" returned: 0 in 5.599s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ef451f-e0e0-4539-9094-910e11ef3ab4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:32 devstack sudo[94396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748
Jul 06 20:52:32 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:33 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748" returned: 0 in 1.139s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:52:33 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Converted 1024.00 MB image at 182.86 MB/s
Jul 06 20:52:33 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542 is being set with open permissions: ugo+rw
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:33 devstack sudo[94403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542
Jul 06 20:52:33 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Flow 'volume_create_manager' (63f04197-21ca-4fe9-838e-bc05dc27c85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ff007-8173-4f57-afdd-768d58ea832d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840ff007-8173-4f57-afdd-768d58ea832d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2072661079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17505b11-d71a-4bc1-a975-dd828f7386cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a6ce1f741f465b89676a65f92c6441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:34Z,use_quota=True,user_id='c9b20b03b1984f829d131cc6640f34bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8793c820-0806-40a3-b9f6-6c4c62373617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8793c820-0806-40a3-b9f6-6c4c62373617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27ab772-6a55-477f-b2a4-57fb3e66d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f27ab772-6a55-477f-b2a4-57fb3e66d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17505b11-d71a-4bc1-a975-dd828f7386cc', 'volume_name': 'volume-17505b11-d71a-4bc1-a975-dd828f7386cc', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e266d7cd-2da3-44cd-9f5c-936f0f3d7806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e266d7cd-2da3-44cd-9f5c-936f0f3d7806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02467348-bef0-445e-8bee-c6d834ec2f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:33 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Volume 17505b11-d71a-4bc1-a975-dd828f7386cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17505b11-d71a-4bc1-a975-dd828f7386cc', 'volume_size': 1}
Jul 06 20:52:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:34 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542" returned: 0 in 0.862s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-cf475600-7f12-4403-b7ca-165de5f5d542" released by "_copy_volume_from_snapshot" :: held 9.748s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Acquiring lock "cinder-quobyte-a0f1d032-f941-4997-8393-edf7726d8deb" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-a0f1d032-f941-4997-8393-edf7726d8deb" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Deleting offline snapshot a0f1d032-f941-4997-8393-edf7726d8deb of volume 357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] snapshot_file for this snap is: volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8337971-6f3c-47e5-839e-fba37600be87]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:34 devstack sudo[94424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb
Jul 06 20:52:34 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:35 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb" returned: 0 in 0.815s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-357190e8-e0f2-4e82-a5b0-4efc24278748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:52:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3592d5-3ebc-4b8f-ac64-4a06558bb73d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:35 devstack sudo[94430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748
Jul 06 20:52:35 devstack sudo[94430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:35 devstack sudo[94430]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748" returned: 0 in 0.736s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:35 devstack sudo[94435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb
Jul 06 20:52:35 devstack sudo[94435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:36 devstack sudo[94435]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb" returned: 0 in 0.749s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:36 devstack sudo[94441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb
Jul 06 20:52:36 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:37 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748.a0f1d032-f941-4997-8393-edf7726d8deb" returned: 0 in 0.726s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-a0f1d032-f941-4997-8393-edf7726d8deb" released by "_delete_snapshot" :: held 3.141s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=116,cinder:UPDATE=135,cinder:INSERT=30,cinder:DELETE=6 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=115,cinder:UPDATE=123,cinder:INSERT=35,cinder:DELETE=7 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.338s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.968s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7f0d7e5d-5cce-41b3-bfcc-6054aa8b5ce5,created_at=2026-07-06T18:52:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-981030479',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7f0d7e5d-5cce-41b3-bfcc-6054aa8b5ce5,host='devstack@QuobyteHD#QuobyteHD',id=5b605709-3c58-4c7a-b14f-13084f790863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a06a75dac4cf8a99bf953c1e680d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:23Z,use_quota=True,user_id='d3927db579e6483694c7f23f6563e493',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d64ef26-141b-4207-be07-8123c6b82f12),volume_type_id=9d64ef26-141b-4207-be07-8123c6b82f12)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Creating volume 5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:37 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:37 devstack sudo[94445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 1073741824
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7da328f0-a7ce-415b-98ad-e0775ed4aea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf475600-7f12-4403-b7ca-165de5f5d542', 'volume_size': 2, 'source_volid': '357190e8-e0f2-4e82-a5b0-4efc24278748', 'source_volstatus': 'available'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:37 devstack sudo[94445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cd7086-81ee-40e3-9854-4afb487caba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:37 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Volume volume-cf475600-7f12-4403-b7ca-165de5f5d542 (cf475600-7f12-4403-b7ca-165de5f5d542): created successfully
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22cd7086-81ee-40e3-9854-4afb487caba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Flow 'volume_create_manager' (5b3d47ff-10e0-41c4-b207-d68b3bc42d51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-04a02b51-6527-432f-b07f-ee1c878bfbef tempest-VolumesCloneTest-1307021463 None] Created volume successfully.
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:37 devstack sudo[94460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:37 devstack sudo[94460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Acquiring lock "cinder-cf475600-7f12-4403-b7ca-165de5f5d542-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Lock "cinder-cf475600-7f12-4403-b7ca-165de5f5d542-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Acquiring lock "cinder-quobyte-cf475600-7f12-4403-b7ca-165de5f5d542" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-cf475600-7f12-4403-b7ca-165de5f5d542" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d007e4b-e4ce-4300-b910-c8a448875146]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:38 devstack sudo[94484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542
Jul 06 20:52:38 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:38 devstack sudo[94460]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.206s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:52:38 devstack sudo[94445]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 1073741824" returned: 0 in 1.548s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:38 devstack sudo[94506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863
Jul 06 20:52:38 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:39 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542" returned: 0 in 1.051s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:39 devstack sudo[94520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542
Jul 06 20:52:39 devstack sudo[94520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:39 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863" returned: 0 in 0.694s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.763s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2072661079',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17505b11-d71a-4bc1-a975-dd828f7386cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a6ce1f741f465b89676a65f92c6441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:34Z,use_quota=True,user_id='c9b20b03b1984f829d131cc6640f34bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Creating volume 17505b11-d71a-4bc1-a975-dd828f7386cc {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:39 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:39 devstack sudo[94533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc 1073741824
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64fc233b-4922-4148-86a4-1e760f32459b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b605709-3c58-4c7a-b14f-13084f790863', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:39 devstack sudo[94533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d6f70f-4505-4aa2-aa62-127162dd708d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:39 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Volume volume-5b605709-3c58-4c7a-b14f-13084f790863 (5b605709-3c58-4c7a-b14f-13084f790863): created successfully
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5d6f70f-4505-4aa2-aa62-127162dd708d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Flow 'volume_create_manager' (da6a69bf-907d-49ef-bc70-6d85f3923d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:39 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-270e3751-8d12-4b36-9137-c04db2e712e2 tempest-GroupSnapshotsTest-2030955167 None] Created volume successfully.
Jul 06 20:52:40 devstack sudo[94520]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cf475600-7f12-4403-b7ca-165de5f5d542" returned: 0 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-cf475600-7f12-4403-b7ca-165de5f5d542" released by "delete_volume" :: held 1.981s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Created reservations ['a414fb14-bc48-4799-b2ad-42cc52c436d6', 'ae1d819b-d667-4def-aa8e-58dca5098bf4', '79fd9e5f-aed3-4d30-9fa9-568fb71290ca', '23c228e5-3597-42f1-951d-17b5971ae713'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:40 devstack sudo[94538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:40 devstack sudo[94538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:40 devstack sudo[94533]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc 1073741824" returned: 0 in 0.909s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:40 devstack sudo[94543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc
Jul 06 20:52:40 devstack sudo[94543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:41 devstack sudo[94538]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.928s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Deleted volume successfully.
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-85470ca1-3e80-4795-b37d-e2f44b4f1567 tempest-VolumesCloneTest-1307021463 None] Lock "cinder-cf475600-7f12-4403-b7ca-165de5f5d542-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] GroupSnapshot 1e86cd20-c6db-4178-b3e9-18e8317ed31e: creating.
Jul 06 20:52:41 devstack sudo[94543]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc" returned: 0 in 0.918s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] <== create_volume: return (1888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.896s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Group snapshot 1e86cd20-c6db-4178-b3e9-18e8317ed31e: creating. {{(pid=86721) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02467348-bef0-445e-8bee-c6d834ec2f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17505b11-d71a-4bc1-a975-dd828f7386cc', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4112db0-f19b-4171-b873-c4095fa848fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Acquiring lock "cinder-357190e8-e0f2-4e82-a5b0-4efc24278748-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Creating offline snapshot daf48181-a424-41ef-b41d-d15daa4ae03a of volume 5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Lock "cinder-357190e8-e0f2-4e82-a5b0-4efc24278748-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Volume volume-17505b11-d71a-4bc1-a975-dd828f7386cc (17505b11-d71a-4bc1-a975-dd828f7386cc): created successfully
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4112db0-f19b-4171-b873-c4095fa848fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Flow 'volume_create_manager' (63f04197-21ca-4fe9-838e-bc05dc27c85d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8b24ea-3dce-453d-a274-08e2a84d100a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-577d4718-babb-4586-9dbd-bb14a73a83ed tempest-VolumesTransfersV355Test-1987677518 None] Created volume successfully.
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Acquiring lock "cinder-quobyte-357190e8-e0f2-4e82-a5b0-4efc24278748" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-357190e8-e0f2-4e82-a5b0-4efc24278748" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d7932-dde7-429c-bdba-158bdd16778f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:41 devstack sudo[94549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863
Jul 06 20:52:41 devstack sudo[94549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:41 devstack sudo[94550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748
Jul 06 20:52:41 devstack sudo[94550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:42 devstack sudo[94549]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863" returned: 0 in 1.307s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:43 devstack sudo[94559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a 1G
Jul 06 20:52:43 devstack sudo[94559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:43 devstack sudo[94550]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748" returned: 0 in 1.257s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:43 devstack sudo[94561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748
Jul 06 20:52:43 devstack sudo[94561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4cc3c3e6-fb09-49f1-aa9f-8c0b3ec6a790 tempest-VolumesTransfersV355Test-174008897 None] Transfer volume completed successfully.
Jul 06 20:52:43 devstack sudo[94561]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-357190e8-e0f2-4e82-a5b0-4efc24278748" returned: 0 in 0.778s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Lock "cinder-quobyte-357190e8-e0f2-4e82-a5b0-4efc24278748" released by "delete_volume" :: held 2.112s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Created reservations ['1104930a-29c0-4910-9a28-927142a8475b', '6477839b-2103-4488-9884-151edef9254d', '4596e931-a767-450e-be46-9084f124afdf', '9352bc65-2822-4b96-a305-d77e2c2072a7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:44 devstack sudo[94568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:44 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:44 devstack sudo[94559]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a 1G" returned: 0 in 1.704s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b605709-3c58-4c7a-b14f-13084f790863 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:44 devstack sudo[94572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b605709-3c58-4c7a-b14f-13084f790863 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a
Jul 06 20:52:44 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Acquiring lock "cinder-17505b11-d71a-4bc1-a975-dd828f7386cc-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-17505b11-d71a-4bc1-a975-dd828f7386cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Acquiring lock "cinder-quobyte-17505b11-d71a-4bc1-a975-dd828f7386cc" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-quobyte-17505b11-d71a-4bc1-a975-dd828f7386cc" acquired by "delete_volume" :: waited 0.053s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca106cee-621a-4a63-854e-925f1969eca1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:45 devstack sudo[94574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc
Jul 06 20:52:45 devstack sudo[94574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:45 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.119s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:45 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Deleted volume successfully.
Jul 06 20:52:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93183c5-af39-4d91-bf56-7095b1e3df2e tempest-VolumesCloneTest-1307021463 None] Lock "cinder-357190e8-e0f2-4e82-a5b0-4efc24278748-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:45 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5b605709-3c58-4c7a-b14f-13084f790863 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a" returned: 0 in 1.162s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:45 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:52:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:45 devstack sudo[94580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a
Jul 06 20:52:45 devstack sudo[94580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:46 devstack sudo[94574]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc" returned: 0 in 1.389s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:46 devstack sudo[94585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc
Jul 06 20:52:46 devstack sudo[94585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:46 devstack sudo[94580]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a" returned: 0 in 0.877s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:46 devstack sudo[94588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.info
Jul 06 20:52:46 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:47 devstack sudo[94585]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17505b11-d71a-4bc1-a975-dd828f7386cc" returned: 0 in 0.965s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-quobyte-17505b11-d71a-4bc1-a975-dd828f7386cc" released by "delete_volume" :: held 2.431s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Created reservations ['7927913d-c909-4734-a2ae-4d55d86ebdef', '8cc6c0e0-09fb-4efa-ab3d-9378c8c7d90b', '56ea658b-5b98-45f6-af38-66d4735f9426', '9df86da4-c3bd-45e5-99e9-a434a9805bc3'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:47 devstack sudo[94593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:47 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:47 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.info" returned: 0 in 0.863s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:47 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:52:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:47 devstack sudo[94595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.info
Jul 06 20:52:47 devstack sudo[94595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:48 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.843s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:48 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Deleted volume successfully.
Jul 06 20:52:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2044137a-a9bb-43b0-b41b-1694bcd2c54a tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-17505b11-d71a-4bc1-a975-dd828f7386cc-delete_volume" released by "delete_volume" :: held 3.594s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:48 devstack sudo[94595]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.info" returned: 0 in 0.788s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.834s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-507f71af-1c4f-4179-a05b-4f4e043a3e70 tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 1e86cd20-c6db-4178-b3e9-18e8317ed31e: created successfully
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Flow 'volume_create_manager' (8d4f913a-dbd2-492d-bd38-77fe36cadaf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052d3a27-6908-4b4c-9dcb-8dd10856061f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (052d3a27-6908-4b4c-9dcb-8dd10856061f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1085270753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570097f6-77be-4367-bb1f-90a080ce997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a6ce1f741f465b89676a65f92c6441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:49Z,use_quota=True,user_id='c9b20b03b1984f829d131cc6640f34bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676610ec-aab1-4c06-8845-61283e141420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (676610ec-aab1-4c06-8845-61283e141420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd3cf1c-cdb9-471b-abf7-be7284f22b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd3cf1c-cdb9-471b-abf7-be7284f22b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '570097f6-77be-4367-bb1f-90a080ce997f', 'volume_name': 'volume-570097f6-77be-4367-bb1f-90a080ce997f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3be65a1-aedb-4b89-bfb2-73026b41cbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3be65a1-aedb-4b89-bfb2-73026b41cbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39813e0-f7e6-452a-b43d-fe8318c358bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:49 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Volume 570097f6-77be-4367-bb1f-90a080ce997f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-570097f6-77be-4367-bb1f-90a080ce997f', 'volume_size': 1}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1085270753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=570097f6-77be-4367-bb1f-90a080ce997f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42a6ce1f741f465b89676a65f92c6441',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:49Z,use_quota=True,user_id='c9b20b03b1984f829d131cc6640f34bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Creating volume 570097f6-77be-4367-bb1f-90a080ce997f {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:49 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 1e86cd20-c6db-4178-b3e9-18e8317ed31e: deleting
Jul 06 20:52:49 devstack sudo[94599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f 1073741824
Jul 06 20:52:49 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 1e86cd20-c6db-4178-b3e9-18e8317ed31e: deleting {{(pid=86721) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-5b605709-3c58-4c7a-b14f-13084f790863" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-5b605709-3c58-4c7a-b14f-13084f790863" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-daf48181-a424-41ef-b41d-d15daa4ae03a" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-daf48181-a424-41ef-b41d-d15daa4ae03a" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Deleting offline snapshot daf48181-a424-41ef-b41d-d15daa4ae03a of volume 5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] snapshot_file for this snap is: volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ba621d-b379-48af-afbe-257589dc9f94]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:49 devstack sudo[94601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a
Jul 06 20:52:49 devstack sudo[94601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (bffd6ae6-651c-443e-a06b-be41adc12948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bd3d6f-cdac-46a7-8d56-b6ce6ff75e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3bd3d6f-cdac-46a7-8d56-b6ce6ff75e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432121980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d61d9f0-e137-440f-b810-54acbc87e227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:50Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c07da09-e809-4f75-9939-a978f87db78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c07da09-e809-4f75-9939-a978f87db78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f006ef58-2f28-40ab-9afa-34b98dbe2d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f006ef58-2f28-40ab-9afa-34b98dbe2d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d61d9f0-e137-440f-b810-54acbc87e227', 'volume_name': 'volume-0d61d9f0-e137-440f-b810-54acbc87e227', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5566ba75-b257-4608-a7c9-eec32ab91ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5566ba75-b257-4608-a7c9-eec32ab91ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27901857-26fc-4963-bdab-32fb61906ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Volume 0d61d9f0-e137-440f-b810-54acbc87e227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d61d9f0-e137-440f-b810-54acbc87e227', 'volume_size': 1}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (ff27d755-2f11-4264-bf20-758782dbabdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49611eb7-81da-429b-aa23-841880c81992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49611eb7-81da-429b-aa23-841880c81992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549199397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0663d167-919f-4fd5-b396-a8265bdc58fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:50Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5edf1e-8208-4673-a292-0c3261d920e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5edf1e-8208-4673-a292-0c3261d920e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5513313e-d2f5-446c-8a9c-f40794eccce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5513313e-d2f5-446c-8a9c-f40794eccce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0663d167-919f-4fd5-b396-a8265bdc58fe', 'volume_name': 'volume-0663d167-919f-4fd5-b396-a8265bdc58fe', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac70e982-bc07-4434-ae58-e077b32b52a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac70e982-bc07-4434-ae58-e077b32b52a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9d9cc-edf4-43ca-9f13-f36a0321c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Volume 0663d167-919f-4fd5-b396-a8265bdc58fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0663d167-919f-4fd5-b396-a8265bdc58fe', 'volume_size': 1}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:50 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:50 devstack sudo[94601]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f 1073741824" returned: 0 in 1.599s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a" returned: 0 in 1.322s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5b605709-3c58-4c7a-b14f-13084f790863(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26c3702-8614-4a03-aad8-147f5b4590cd]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:50 devstack sudo[94612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f
Jul 06 20:52:50 devstack sudo[94612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (0b302bfe-bd2e-476e-9012-db72cf3feeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7335e6-df26-4338-b15e-418f2f221e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack sudo[94611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863
Jul 06 20:52:51 devstack sudo[94611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7335e6-df26-4338-b15e-418f2f221e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-591431145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491df631-2f67-4475-aa35-4b773a3164ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:51Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da10ef39-2b42-4751-8d9f-83ed0f648ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da10ef39-2b42-4751-8d9f-83ed0f648ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d6b9bc-4677-47d5-afb0-1143b7eed940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0d6b9bc-4677-47d5-afb0-1143b7eed940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491df631-2f67-4475-aa35-4b773a3164ac', 'volume_name': 'volume-491df631-2f67-4475-aa35-4b773a3164ac', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffcd9e8-19d9-40bb-824b-5be52eed3214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ffcd9e8-19d9-40bb-824b-5be52eed3214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e2a8dd-3417-45ed-b7eb-1b5b0ca86c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Volume 491df631-2f67-4475-aa35-4b773a3164ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491df631-2f67-4475-aa35-4b773a3164ac', 'volume_size': 1}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (fb5b5f71-f4bc-428a-a854-847c91bbfdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7327cc-0e99-46d5-a979-5b4afe87581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e7327cc-0e99-46d5-a979-5b4afe87581c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1142145544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d3b777-63d6-49a5-bfde-25f77d12a1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:51Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05485a73-dfbd-44e8-9c67-aced81fc93aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05485a73-dfbd-44e8-9c67-aced81fc93aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a220cf-aa75-4d9f-bb16-d33bbb6ff536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30a220cf-aa75-4d9f-bb16-d33bbb6ff536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1d3b777-63d6-49a5-bfde-25f77d12a1ec', 'volume_name': 'volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3c4470-188a-44d3-911e-9eb7ee922bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d3c4470-188a-44d3-911e-9eb7ee922bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb0bfb4-927b-4bc1-a730-84b130e30404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Volume b1d3b777-63d6-49a5-bfde-25f77d12a1ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec', 'volume_size': 1}
Jul 06 20:52:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:52:52 devstack sudo[94612]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (d7debe37-59ab-4e4a-b9d8-8fa0c232012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186164ba-8fcf-4add-9fc9-df5f99d9c634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f" returned: 0 in 1.186s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] <== create_volume: return (2888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.893s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:52 devstack sudo[94611]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.052s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432121980',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d61d9f0-e137-440f-b810-54acbc87e227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:50Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Creating volume 0d61d9f0-e137-440f-b810-54acbc87e227 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:52 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (186164ba-8fcf-4add-9fc9-df5f99d9c634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-110747617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c922205-47b1-4935-a7fd-3acfc5619c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:52Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:52 devstack sudo[94619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227 1073741824
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8a7ec4-a1cb-4862-a327-039f486e51a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:52 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d8a7ec4-a1cb-4862-a327-039f486e51a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2186c0-e136-44f0-947b-3f5f605b1ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2186c0-e136-44f0-947b-3f5f605b1ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c922205-47b1-4935-a7fd-3acfc5619c34', 'volume_name': 'volume-3c922205-47b1-4935-a7fd-3acfc5619c34', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80919da3-dcc8-4d60-b621-086cfe9c01f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80919da3-dcc8-4d60-b621-086cfe9c01f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038cc2cc-dc4f-4031-9162-3a6a07dbb8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:52 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Volume 3c922205-47b1-4935-a7fd-3acfc5619c34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c922205-47b1-4935-a7fd-3acfc5619c34', 'volume_size': 1}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863" returned: 0 in 1.345s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d39813e0-f7e6-452a-b43d-fe8318c358bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-570097f6-77be-4367-bb1f-90a080ce997f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b2710c-9b00-4d7a-b548-7687b11b7bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:52 devstack sudo[94623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a
Jul 06 20:52:52 devstack sudo[94623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:52 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Volume volume-570097f6-77be-4367-bb1f-90a080ce997f (570097f6-77be-4367-bb1f-90a080ce997f): created successfully
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b2710c-9b00-4d7a-b548-7687b11b7bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Flow 'volume_create_manager' (8d4f913a-dbd2-492d-bd38-77fe36cadaf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-35f231ec-d30d-4138-995b-d5b00dc523d2 tempest-VolumesTransfersV355Test-1987677518 None] Created volume successfully.
Jul 06 20:52:53 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227 1073741824" returned: 0 in 0.910s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:53 devstack sudo[94623]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a" returned: 0 in 0.851s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:53 devstack sudo[94657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a
Jul 06 20:52:53 devstack sudo[94657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:53 devstack sudo[94658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227
Jul 06 20:52:53 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Acquiring lock "cinder-570097f6-77be-4367-bb1f-90a080ce997f-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-570097f6-77be-4367-bb1f-90a080ce997f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Acquiring lock "cinder-quobyte-570097f6-77be-4367-bb1f-90a080ce997f" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-quobyte-570097f6-77be-4367-bb1f-90a080ce997f" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42bba04-0aa5-4a43-bcb0-518103e26e44]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:53 devstack sudo[94657]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863.daf48181-a424-41ef-b41d-d15daa4ae03a" returned: 0 in 0.690s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:53 devstack sudo[94662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f
Jul 06 20:52:53 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-daf48181-a424-41ef-b41d-d15daa4ae03a" released by "_delete_snapshot" :: held 4.379s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-5b605709-3c58-4c7a-b14f-13084f790863" released by "delete_snapshot" :: held 4.442s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:53 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227" returned: 0 in 0.764s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.430s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-549199397',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0663d167-919f-4fd5-b396-a8265bdc58fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:50Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Creating volume 0663d167-919f-4fd5-b396-a8265bdc58fe {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:53 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27901857-26fc-4963-bdab-32fb61906ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d61d9f0-e137-440f-b810-54acbc87e227', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:53 devstack sudo[94665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe 1073741824
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c863cece-c01d-4ac1-b3f3-0c8324c09e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:53 devstack sudo[94665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Volume volume-0d61d9f0-e137-440f-b810-54acbc87e227 (0d61d9f0-e137-440f-b810-54acbc87e227): created successfully
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c863cece-c01d-4ac1-b3f3-0c8324c09e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (bffd6ae6-651c-443e-a06b-be41adc12948) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:53 devstack cinder-volume[86721]: WARNING cinder.quota [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2082498851 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2082498851, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:52:53 devstack cinder-volume[86721]: WARNING cinder.quota [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2082498851 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2082498851, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:52:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-aec9a18d-1702-428e-86b1-c842f4294e34 tempest-CreateVolumesFromImageTest-684247788 None] Created volume successfully.
Jul 06 20:52:54 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['97a86d0b-aece-4b74-8db7-eee737956c39', '7a272c5b-4f73-4230-82cf-d63fd01ba25b', '862ab66a-c8db-43ba-a0f7-912a5c9a7261', '7d7d5c4b-4282-494a-a67a-c75cba78139d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3d5ae98f-4e2c-4e6d-99cf-b8c760bb0aa2 tempest-GroupSnapshotsTest-2030955167 None] group_snapshot 1e86cd20-c6db-4178-b3e9-18e8317ed31e: deleted successfully
Jul 06 20:52:54 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f" returned: 0 in 0.823s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:54 devstack sudo[94671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f
Jul 06 20:52:54 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:54 devstack sudo[94665]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe 1073741824" returned: 0 in 0.933s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:54 devstack sudo[94675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe
Jul 06 20:52:54 devstack sudo[94675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:55 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-570097f6-77be-4367-bb1f-90a080ce997f" returned: 0 in 0.668s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-quobyte-570097f6-77be-4367-bb1f-90a080ce997f" released by "delete_volume" :: held 1.542s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Created reservations ['1b19a906-8b21-41e5-bf19-35b8bc986f5e', '8a029be2-525d-454f-bc00-6b8a94a2dbf6', 'e2dadbef-a95c-4aa3-8375-ca4898eadbb7', '57529fc5-c54e-440a-809e-50ba837938ba'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "cinder-quobyte-5b605709-3c58-4c7a-b14f-13084f790863" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-5b605709-3c58-4c7a-b14f-13084f790863" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0297a7db-29d1-4a3a-9e5c-ea38e0d62896]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:55 devstack sudo[94678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:55 devstack sudo[94678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:55 devstack sudo[94679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863
Jul 06 20:52:55 devstack sudo[94679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:55 devstack sudo[94675]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe" returned: 0 in 0.681s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.387s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-591431145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491df631-2f67-4475-aa35-4b773a3164ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:51Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Creating volume 491df631-2f67-4475-aa35-4b773a3164ac {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:55 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9d9cc-edf4-43ca-9f13-f36a0321c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0663d167-919f-4fd5-b396-a8265bdc58fe', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ca1c23-5026-4211-8bc6-2268a75435ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:55 devstack sudo[94683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac 1073741824
Jul 06 20:52:55 devstack sudo[94683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Volume volume-0663d167-919f-4fd5-b396-a8265bdc58fe (0663d167-919f-4fd5-b396-a8265bdc58fe): created successfully
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0ca1c23-5026-4211-8bc6-2268a75435ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (ff27d755-2f11-4264-bf20-758782dbabdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-343b9683-a0e5-4a95-96cd-41c405bfbd83 tempest-CreateVolumesFromImageTest-684247788 None] Created volume successfully.
Jul 06 20:52:56 devstack sudo[94678]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.779s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:56 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Deleted volume successfully.
Jul 06 20:52:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-220dc99f-37ec-44fc-8079-f0c7abb4553f tempest-VolumesTransfersV355Test-663233551 None] Lock "cinder-570097f6-77be-4367-bb1f-90a080ce997f-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:56 devstack sudo[94679]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863" returned: 0 in 0.961s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:56 devstack sudo[94693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863
Jul 06 20:52:56 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:56 devstack sudo[94683]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac 1073741824" returned: 0 in 1.021s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:56 devstack sudo[94697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac
Jul 06 20:52:56 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:57 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b605709-3c58-4c7a-b14f-13084f790863" returned: 0 in 0.754s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Lock "cinder-quobyte-5b605709-3c58-4c7a-b14f-13084f790863" released by "delete_volume" :: held 1.820s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['1382602c-8e6f-4c89-8a2a-08121b71e7a4'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:57 devstack cinder-volume[86721]: WARNING cinder.quota [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2082498851 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2082498851, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Created reservations ['099e60ad-63cc-4244-b8cc-6b0c745dd88f', '16bf1d05-64da-428b-8968-5bed18107565', '71e63deb-9418-450c-b810-857a368d2a3f', 'cd9c7375-1dc3-422c-ad94-d781c4dd274f'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:52:57 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac" returned: 0 in 0.791s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.698s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1142145544',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1d3b777-63d6-49a5-bfde-25f77d12a1ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:51Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Creating volume b1d3b777-63d6-49a5-bfde-25f77d12a1ec {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:57 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e2a8dd-3417-45ed-b7eb-1b5b0ca86c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491df631-2f67-4475-aa35-4b773a3164ac', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:57 devstack sudo[94702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec 1073741824
Jul 06 20:52:57 devstack sudo[94702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50efba3a-1464-458a-917b-9e8b73ae63b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:57 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Volume volume-491df631-2f67-4475-aa35-4b773a3164ac (491df631-2f67-4475-aa35-4b773a3164ac): created successfully
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50efba3a-1464-458a-917b-9e8b73ae63b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:57 devstack sudo[94704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:52:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (0b302bfe-bd2e-476e-9012-db72cf3feeb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:57 devstack sudo[94704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:57 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a8459d10-0948-4b52-9cf9-6c32e2af8023 tempest-CreateVolumesFromImageTest-684247788 None] Created volume successfully.
Jul 06 20:52:58 devstack sudo[94704]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.185s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:58 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:52:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7e8fb57f-8fad-4dd9-8140-484d7478479d tempest-GroupSnapshotsTest-2030955167 None] Delete group completed successfully.
Jul 06 20:52:58 devstack sudo[94702]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec 1073741824" returned: 0 in 1.360s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:58 devstack sudo[94712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec
Jul 06 20:52:58 devstack sudo[94712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:59 devstack sudo[94712]: pam_unix(sudo:session): session closed for user root
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec" returned: 0 in 0.867s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.311s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.523s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-110747617',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c922205-47b1-4935-a7fd-3acfc5619c34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24af494fc76e4f12beea18fc18a11bc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:52:52Z,use_quota=True,user_id='9afa139961ee446f97ed80e3b432b473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Creating volume 3c922205-47b1-4935-a7fd-3acfc5619c34 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:52:59 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:52:59 devstack sudo[94715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34 1073741824
Jul 06 20:52:59 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcb0bfb4-927b-4bc1-a730-84b130e30404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b6c347-a008-481c-a674-312a96ebca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:52:59 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Volume volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec (b1d3b777-63d6-49a5-bfde-25f77d12a1ec): created successfully
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6b6c347-a008-481c-a674-312a96ebca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:52:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (fb5b5f71-f4bc-428a-a854-847c91bbfdab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:52:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d2e290e1-a264-4894-a0f1-3b6de28361cb tempest-CreateVolumesFromImageTest-684247788 None] Created volume successfully.
Jul 06 20:53:00 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34 1073741824" returned: 0 in 1.148s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:00 devstack sudo[94721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34
Jul 06 20:53:00 devstack sudo[94721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:01 devstack sudo[94721]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34" returned: 0 in 0.667s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (038cc2cc-dc4f-4031-9162-3a6a07dbb8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c922205-47b1-4935-a7fd-3acfc5619c34', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a68e44-20b6-454c-8a78-d60877157735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:01 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Volume volume-3c922205-47b1-4935-a7fd-3acfc5619c34 (3c922205-47b1-4935-a7fd-3acfc5619c34): created successfully
Jul 06 20:53:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a68e44-20b6-454c-8a78-d60877157735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Flow 'volume_create_manager' (d7debe37-59ab-4e4a-b9d8-8fa0c232012b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:01 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9cc21c70-dfcc-4397-83f0-b88c40482970 tempest-CreateVolumesFromImageTest-684247788 None] Created volume successfully.
Jul 06 20:53:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-3c922205-47b1-4935-a7fd-3acfc5619c34-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-3c922205-47b1-4935-a7fd-3acfc5619c34-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-quobyte-3c922205-47b1-4935-a7fd-3acfc5619c34" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-3c922205-47b1-4935-a7fd-3acfc5619c34" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:02 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4860018b-2ca2-41a2-ab3b-33e0b509f5c9]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:02 devstack sudo[94724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34
Jul 06 20:53:02 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:03 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34" returned: 0 in 1.058s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:03 devstack sudo[94763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34
Jul 06 20:53:03 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:04 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3c922205-47b1-4935-a7fd-3acfc5619c34" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-3c922205-47b1-4935-a7fd-3acfc5619c34" released by "delete_volume" :: held 1.931s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Created reservations ['1cbcfb30-0e47-4957-b2ea-bce9bf5bbc21', '778c7210-2c7b-438a-adaf-b1d64fb244df', '2d5f3dbf-466c-4b10-9127-cbede944a229', 'bfdfde9c-b025-443b-9c7e-d8ddf7e5d0b0'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:04 devstack sudo[94770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:04 devstack sudo[94770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:04 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-deeefaaa-e22d-42b6-ba27-0b02786c391c tempest-GroupsV314Test-377242029 None] Group tempest-GroupsV314Test-Group-313003235: creating
Jul 06 20:53:04 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-deeefaaa-e22d-42b6-ba27-0b02786c391c tempest-GroupsV314Test-377242029 None] Group tempest-GroupsV314Test-Group-313003235: created successfully
Jul 06 20:53:04 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-deeefaaa-e22d-42b6-ba27-0b02786c391c tempest-GroupsV314Test-377242029 None] Create group completed successfully.
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-b1d3b777-63d6-49a5-bfde-25f77d12a1ec-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-b1d3b777-63d6-49a5-bfde-25f77d12a1ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-quobyte-b1d3b777-63d6-49a5-bfde-25f77d12a1ec" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-b1d3b777-63d6-49a5-bfde-25f77d12a1ec" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c5ebe5-8069-4553-9383-cf4cc433d340]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:04 devstack sudo[94772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec
Jul 06 20:53:04 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Flow 'volume_create_manager' (28568aa8-b58c-4452-a72e-d597a67ccef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5ebe2a-567a-4a4a-aab8-7acc93ab7f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee5ebe2a-567a-4a4a-aab8-7acc93ab7f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-561371438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1298f582-8aff-437c-be6b-20ead1aebde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b855a0dca0437ca9bedc25444d8557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:05Z,use_quota=True,user_id='87f326d2051b40138255c18ccb9d8825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4914915d-6ca8-4595-b977-d49d590065d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4914915d-6ca8-4595-b977-d49d590065d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebc75ac-8644-4bd1-86bb-ae0339c2d3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aebc75ac-8644-4bd1-86bb-ae0339c2d3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1298f582-8aff-437c-be6b-20ead1aebde2', 'volume_name': 'volume-1298f582-8aff-437c-be6b-20ead1aebde2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1e47fd-4510-469f-9971-64f84e55e6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1e47fd-4510-469f-9971-64f84e55e6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d70106-d5c7-4bab-a5c3-65252178683a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:05 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Volume 1298f582-8aff-437c-be6b-20ead1aebde2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1298f582-8aff-437c-be6b-20ead1aebde2', 'volume_size': 1}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-561371438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1298f582-8aff-437c-be6b-20ead1aebde2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b855a0dca0437ca9bedc25444d8557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:05Z,use_quota=True,user_id='87f326d2051b40138255c18ccb9d8825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Creating volume 1298f582-8aff-437c-be6b-20ead1aebde2 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:05 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:05 devstack sudo[94774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2 1073741824
Jul 06 20:53:05 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:05 devstack sudo[94770]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.072s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Deleted volume successfully.
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50677b96-2a86-4f53-8a04-ff3814c2f27a tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-3c922205-47b1-4935-a7fd-3acfc5619c34-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:05 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec" returned: 0 in 0.972s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:05 devstack sudo[94780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec
Jul 06 20:53:05 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:06 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2 1073741824" returned: 0 in 1.117s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:06 devstack sudo[94786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2
Jul 06 20:53:06 devstack sudo[94786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Flow 'volume_create_manager' (ae9d00c9-ffd9-4514-aa2c-f59ae294b704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ac75b-5687-4fa4-a97a-f3f053db97df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e01ac75b-5687-4fa4-a97a-f3f053db97df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587388715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=839945ac-88b8-4501-8a2f-b425d5f13685,host='devstack@QuobyteHD#QuobyteHD',id=05b02c5b-30f0-4ab8-a555-a45bb27c730d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788b3fc4fbe0498798f6be3fdcac66d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:06Z,use_quota=True,user_id='f048c6e281c640a790f60a08f62e9634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f82f751e-fcfb-4070-a839-b5bda21d7379),volume_type_id=f82f751e-fcfb-4070-a839-b5bda21d7379)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9120a0b0-95a1-4b0b-b7d3-4cc6313f0381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9120a0b0-95a1-4b0b-b7d3-4cc6313f0381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435e7bdc-e757-430e-80d6-51fa00ace6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435e7bdc-e757-430e-80d6-51fa00ace6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05b02c5b-30f0-4ab8-a555-a45bb27c730d', 'volume_name': 'volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66546fc-e722-4c29-b76b-83cc6445c6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c66546fc-e722-4c29-b76b-83cc6445c6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a782ea-34ee-4ff6-a4af-7b5034cced98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:06 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Volume 05b02c5b-30f0-4ab8-a555-a45bb27c730d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d', 'volume_size': 1}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:06 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b1d3b777-63d6-49a5-bfde-25f77d12a1ec" returned: 0 in 0.927s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-b1d3b777-63d6-49a5-bfde-25f77d12a1ec" released by "delete_volume" :: held 1.968s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Created reservations ['d2b2ebe9-7e5f-46ad-acf7-269f4704f63e', '269e1714-1c97-4840-bec0-8e43e96e025d', 'eb74b333-4040-47d2-b338-4d5d9038ff1f', '8c799a9c-6749-445f-9f7f-6c15afa0ccc7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:06 devstack sudo[94790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:06 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-491df631-2f67-4475-aa35-4b773a3164ac-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-491df631-2f67-4475-aa35-4b773a3164ac-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-quobyte-491df631-2f67-4475-aa35-4b773a3164ac" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-491df631-2f67-4475-aa35-4b773a3164ac" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ddf8e6-9a89-4157-b3b2-1f9264a9962f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:07 devstack sudo[94786]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2" returned: 0 in 0.918s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] <== create_volume: return (2123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=839945ac-88b8-4501-8a2f-b425d5f13685,created_at=2026-07-06T18:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587388715',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=839945ac-88b8-4501-8a2f-b425d5f13685,host='devstack@QuobyteHD#QuobyteHD',id=05b02c5b-30f0-4ab8-a555-a45bb27c730d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='788b3fc4fbe0498798f6be3fdcac66d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:06Z,use_quota=True,user_id='f048c6e281c640a790f60a08f62e9634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f82f751e-fcfb-4070-a839-b5bda21d7379),volume_type_id=f82f751e-fcfb-4070-a839-b5bda21d7379)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Creating volume 05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:07 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:07 devstack sudo[94793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac
Jul 06 20:53:07 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d70106-d5c7-4bab-a5c3-65252178683a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1298f582-8aff-437c-be6b-20ead1aebde2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:07 devstack sudo[94794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d 1073741824
Jul 06 20:53:07 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bb9dfc-b37a-468b-add7-5ffcc780ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:07 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Volume volume-1298f582-8aff-437c-be6b-20ead1aebde2 (1298f582-8aff-437c-be6b-20ead1aebde2): created successfully
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bb9dfc-b37a-468b-add7-5ffcc780ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Flow 'volume_create_manager' (28568aa8-b58c-4452-a72e-d597a67ccef3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-02dbcbe1-f24e-4a30-9b95-4aeb09990b00 tempest-AttachVolumeTestJSON-1874748075 None] Created volume successfully.
Jul 06 20:53:07 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.013s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Deleted volume successfully.
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d34fb8ed-89f4-452a-914e-7b9efdb842b5 tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-b1d3b777-63d6-49a5-bfde-25f77d12a1ec-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:07 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac" returned: 0 in 0.936s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:08 devstack sudo[94810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac
Jul 06 20:53:08 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:08 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d 1073741824" returned: 0 in 1.386s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:08 devstack sudo[94820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d
Jul 06 20:53:08 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:08 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-491df631-2f67-4475-aa35-4b773a3164ac" returned: 0 in 0.855s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-491df631-2f67-4475-aa35-4b773a3164ac" released by "delete_volume" :: held 1.861s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Created reservations ['06ee4854-bd17-4256-a590-932a1e4c8795', 'c082ce50-5735-4b4b-ba32-344ac7b2e15e', 'aca7517a-c670-4635-9ba1-54aa733d6430', '4b7049af-6f08-4b3f-8b68-c7cb745d1f5c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:09 devstack sudo[94823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:09 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-0663d167-919f-4fd5-b396-a8265bdc58fe-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-0663d167-919f-4fd5-b396-a8265bdc58fe-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-quobyte-0663d167-919f-4fd5-b396-a8265bdc58fe" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-0663d167-919f-4fd5-b396-a8265bdc58fe" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[689fb379-dcee-4883-b8f7-e778ffb9b643]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:09 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d" returned: 0 in 1.105s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] <== create_volume: return (2550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.553s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:09 devstack sudo[94826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe
Jul 06 20:53:09 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a782ea-34ee-4ff6-a4af-7b5034cced98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7f930f-15cf-4394-86f6-4adbb78b2f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:09 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Volume volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d (05b02c5b-30f0-4ab8-a555-a45bb27c730d): created successfully
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f7f930f-15cf-4394-86f6-4adbb78b2f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Flow 'volume_create_manager' (ae9d00c9-ffd9-4514-aa2c-f59ae294b704) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ae06654d-34f4-40ef-be9e-867764edcaaa tempest-GroupsV314Test-377242029 None] Created volume successfully.
Jul 06 20:53:10 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.972s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:10 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Deleted volume successfully.
Jul 06 20:53:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6eb8df71-cbb6-4839-8745-4c1f5bb08dcd tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-491df631-2f67-4475-aa35-4b773a3164ac-delete_volume" released by "delete_volume" :: held 3.383s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:10 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe" returned: 0 in 1.081s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:10 devstack sudo[94832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe
Jul 06 20:53:10 devstack sudo[94832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:11 devstack sudo[94832]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0663d167-919f-4fd5-b396-a8265bdc58fe" returned: 0 in 0.839s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-0663d167-919f-4fd5-b396-a8265bdc58fe" released by "delete_volume" :: held 2.011s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Created reservations ['791a644a-92c0-4833-a14f-57a563d5abba', '7d0d506b-4207-4fa7-b1eb-1a312bcca868', 'c636d753-d1fe-4355-ad9e-814b1a302a92', 'a2ef44d7-ecd3-4a64-8f0c-5e829601f454'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:11 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Cloning volume 05b02c5b-30f0-4ab8-a555-a45bb27c730d to volume 638cbe32-3f76-4106-809b-bcd5f30c2a86
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-a05ededc-3e2a-4509-bca7-a7531a1600e8 req-4308ee07-d4e8-4d78-ab95-2562272381e6 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:11 devstack sudo[94844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:11 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Creating offline snapshot d8b9ee65-6151-41ab-b2ff-0cc84ead5861 of volume 05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb100235-3fb4-4ebf-9332-be303568ccde]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:12 devstack sudo[94846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d
Jul 06 20:53:12 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-0d61d9f0-e137-440f-b810-54acbc87e227-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-0d61d9f0-e137-440f-b810-54acbc87e227-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "cinder-quobyte-0d61d9f0-e137-440f-b810-54acbc87e227" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-0d61d9f0-e137-440f-b810-54acbc87e227" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[618d8dce-70c0-423f-9d7e-0f6beab50f1f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:12 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.797s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Deleted volume successfully.
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-15dff377-14c1-4ed1-8c13-05771c5d706c tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-0663d167-919f-4fd5-b396-a8265bdc58fe-delete_volume" released by "delete_volume" :: held 3.268s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:12 devstack sudo[94849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227
Jul 06 20:53:12 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:12 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d" returned: 0 in 1.064s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:12 devstack sudo[94854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 1G
Jul 06 20:53:12 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:13 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227" returned: 0 in 1.175s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:13 devstack sudo[94860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227
Jul 06 20:53:13 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:13 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 1G" returned: 0 in 1.052s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:14 devstack sudo[94866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861
Jul 06 20:53:14 devstack sudo[94866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Flow 'volume_create_manager' (2cabbc88-1c28-4107-9079-e7dedd734e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad17b3ca-28dd-48e4-9875-9b45e14544fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad17b3ca-28dd-48e4-9875-9b45e14544fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532372720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1674415f-6318-4756-a9f0-c6453ecfc373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7418f311254a278bdca9d3fbbb1fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:14Z,use_quota=True,user_id='a0b84a27d5064fd68a887c3861fe3809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c40f8fd-310a-412f-b082-d1323bfd1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c40f8fd-310a-412f-b082-d1323bfd1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08df370-c64e-4dc1-827e-042d91c33e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b08df370-c64e-4dc1-827e-042d91c33e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1674415f-6318-4756-a9f0-c6453ecfc373', 'volume_name': 'volume-1674415f-6318-4756-a9f0-c6453ecfc373', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c3dac-e9ac-4144-a608-feea592838ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78c3dac-e9ac-4144-a608-feea592838ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74343fbe-dc48-47e2-b503-9c1124256a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:14 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Volume 1674415f-6318-4756-a9f0-c6453ecfc373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1674415f-6318-4756-a9f0-c6453ecfc373', 'volume_size': 1}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:14 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0d61d9f0-e137-440f-b810-54acbc87e227" returned: 0 in 0.752s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-quobyte-0d61d9f0-e137-440f-b810-54acbc87e227" released by "delete_volume" :: held 1.975s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Created reservations ['e7d4547b-3954-4e53-9a5f-c796a5b0af0e', '183a5fe1-cc3e-428e-a8c7-322c4e3fdd83', '9aabcc00-6c6f-468b-9d5d-6edb5cecbc8c', 'ab7d185a-4774-4bdf-a013-ea3d110ab4c1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:14 devstack sudo[94869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:14 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:14 devstack sudo[94866]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861" returned: 0 in 0.784s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:14 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:53:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:14 devstack sudo[94874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861
Jul 06 20:53:14 devstack sudo[94874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:15 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.703s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:15 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:15 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Deleted volume successfully.
Jul 06 20:53:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89e5da60-f0d2-4543-9bba-4318f815e2dc tempest-CreateVolumesFromImageTest-684247788 None] Lock "cinder-0d61d9f0-e137-440f-b810-54acbc87e227-delete_volume" released by "delete_volume" :: held 2.927s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:15 devstack sudo[94874]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861" returned: 0 in 0.688s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:15 devstack sudo[94878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.info
Jul 06 20:53:15 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:16 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.info" returned: 0 in 0.705s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:16 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.info is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:53:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:16 devstack sudo[94881]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.info
Jul 06 20:53:16 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:16 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.info" returned: 0 in 0.752s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Acquiring lock "cinder-quobyte-638cbe32-3f76-4106-809b-bcd5f30c2a86" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-638cbe32-3f76-4106-809b-bcd5f30c2a86" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] snapshot: d8b9ee65-6151-41ab-b2ff-0cc84ead5861, volume: 638cbe32-3f76-4106-809b-bcd5f30c2a86,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcfd44e1-bde9-4dd7-b355-9a6b3bb32f43]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:17 devstack sudo[94884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861
Jul 06 20:53:17 devstack sudo[94884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:17 devstack sudo[94884]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861" returned: 0 in 0.785s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f5a72c-e8d7-469a-b065-82fea4f0f1c2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:17 devstack sudo[94891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d
Jul 06 20:53:17 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (20502fe4-8d6b-4898-9c88-426d57480125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c919372a-3936-4df7-b34a-154f0a3daf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c919372a-3936-4df7-b34a-154f0a3daf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674479259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583e719-3c69-4b0c-8419-1d2c267b9a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:18Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62cd503-6c7d-4e0e-897c-916d13661714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e62cd503-6c7d-4e0e-897c-916d13661714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9315093e-21b0-4a35-8288-f93358b1d5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9315093e-21b0-4a35-8288-f93358b1d5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a583e719-3c69-4b0c-8419-1d2c267b9a54', 'volume_name': 'volume-a583e719-3c69-4b0c-8419-1d2c267b9a54', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c8722-1557-4fb1-afd8-f59c9119db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (777c8722-1557-4fb1-afd8-f59c9119db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e52d269-55e6-43bb-806b-3ebfa9edfbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:18 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume a583e719-3c69-4b0c-8419-1d2c267b9a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a583e719-3c69-4b0c-8419-1d2c267b9a54', 'volume_size': 1}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:18 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d" returned: 0 in 0.885s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:53:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:18 devstack sudo[94896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86
Jul 06 20:53:18 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:23 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86" returned: 0 in 4.618s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7f2fce-3c4b-40e9-ba7e-dbc38a04fd15]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:23 devstack sudo[94915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d
Jul 06 20:53:23 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:24 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d" returned: 0 in 0.930s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:24 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d, size 1024.00 MB, duration 4.62 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:53:24 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Converted 1024.00 MB image at 221.69 MB/s
Jul 06 20:53:24 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86 is being set with open permissions: ugo+rw: NotImplementedError
Jul 06 20:53:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:24 devstack sudo[94920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86
Jul 06 20:53:24 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:24 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86" returned: 0 in 0.662s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-638cbe32-3f76-4106-809b-bcd5f30c2a86" released by "_copy_volume_from_snapshot" :: held 7.980s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Acquiring lock "cinder-quobyte-d8b9ee65-6151-41ab-b2ff-0cc84ead5861" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-d8b9ee65-6151-41ab-b2ff-0cc84ead5861" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Deleting offline snapshot d8b9ee65-6151-41ab-b2ff-0cc84ead5861 of volume 05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] snapshot_file for this snap is: volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafc5473-7d63-498b-a0ee-ed295b992fb5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:25 devstack sudo[94923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861
Jul 06 20:53:25 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:25 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861" returned: 0 in 0.783s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b08c87e-d262-4a6c-8c1c-1c1e13f1b387]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:25 devstack sudo[94928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d
Jul 06 20:53:25 devstack sudo[94928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:26 devstack sudo[94928]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d" returned: 0 in 0.809s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:26 devstack sudo[94933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861
Jul 06 20:53:26 devstack sudo[94933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:27 devstack sudo[94933]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861" returned: 0 in 0.758s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:27 devstack sudo[94939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861
Jul 06 20:53:27 devstack sudo[94939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:DELETE=10,cinder:SELECT=88,cinder:INSERT=25,cinder:UPDATE=127 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:53:28 devstack sudo[94939]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d.d8b9ee65-6151-41ab-b2ff-0cc84ead5861" returned: 0 in 0.718s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-d8b9ee65-6151-41ab-b2ff-0cc84ead5861" released by "_delete_snapshot" :: held 3.148s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.368s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-a05ededc-3e2a-4509-bca7-a7531a1600e8 req-4308ee07-d4e8-4d78-ab95-2562272381e6 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 16.346s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a63f4f-510a-4a6e-90e5-a0421663ec31]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-a05ededc-3e2a-4509-bca7-a7531a1600e8 req-4308ee07-d4e8-4d78-ab95-2562272381e6 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:28 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fad675f4-b17c-4369-b804-ef96f40e9532 tempest-GroupsV314Test-377242029 None] Create group from source-group-839945ac-88b8-4501-8a2f-b425d5f13685 completed successfully.
Jul 06 20:53:28 devstack sudo[94942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2
Jul 06 20:53:28 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:28 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-a05ededc-3e2a-4509-bca7-a7531a1600e8 req-4308ee07-d4e8-4d78-ab95-2562272381e6 tempest-AttachVolumeTestJSON-1874748075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2" returned: 0 in 0.779s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-a05ededc-3e2a-4509-bca7-a7531a1600e8 req-4308ee07-d4e8-4d78-ab95-2562272381e6 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.715s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532372720',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1674415f-6318-4756-a9f0-c6453ecfc373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d7418f311254a278bdca9d3fbbb1fa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:14Z,use_quota=True,user_id='a0b84a27d5064fd68a887c3861fe3809',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Creating volume 1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:28 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:29 devstack sudo[94947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 1073741824
Jul 06 20:53:29 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-a05ededc-3e2a-4509-bca7-a7531a1600e8 req-4308ee07-d4e8-4d78-ab95-2562272381e6 tempest-AttachVolumeTestJSON-1874748075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-1298f582-8aff-437c-be6b-20ead1aebde2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f536407-9bcc-420a-82df-e6ebd0f33b4d', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:53:29 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-a05ededc-3e2a-4509-bca7-a7531a1600e8 req-4308ee07-d4e8-4d78-ab95-2562272381e6 tempest-AttachVolumeTestJSON-1874748075 None] attachment_update completed successfully.
Jul 06 20:53:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Acquiring lock "cinder-quobyte-638cbe32-3f76-4106-809b-bcd5f30c2a86" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-638cbe32-3f76-4106-809b-bcd5f30c2a86" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:29 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39c43ab-21ef-4220-8a0c-47506a85c557]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:29 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86
Jul 06 20:53:29 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:29 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 1073741824" returned: 0 in 0.940s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:30 devstack sudo[95023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:53:30 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:30 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86" returned: 0 in 0.888s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:30 devstack sudo[95344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86
Jul 06 20:53:30 devstack sudo[95344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:30 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 0.732s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.564s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1674479259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583e719-3c69-4b0c-8419-1d2c267b9a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:18Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Creating volume a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:30 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74343fbe-dc48-47e2-b503-9c1124256a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1674415f-6318-4756-a9f0-c6453ecfc373', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:30 devstack sudo[95346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 1073741824
Jul 06 20:53:30 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168025bf-ce3b-4325-b7f9-91f24b70fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:30 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Volume volume-1674415f-6318-4756-a9f0-c6453ecfc373 (1674415f-6318-4756-a9f0-c6453ecfc373): created successfully
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168025bf-ce3b-4325-b7f9-91f24b70fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Flow 'volume_create_manager' (2cabbc88-1c28-4107-9079-e7dedd734e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8ab2ede2-644a-40bb-b271-b1ff8f7af2a8 tempest-VolumesActionsTest-2000099908 None] Created volume successfully.
Jul 06 20:53:31 devstack sudo[95344]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-638cbe32-3f76-4106-809b-bcd5f30c2a86" returned: 0 in 0.693s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-638cbe32-3f76-4106-809b-bcd5f30c2a86" released by "delete_volume" :: held 1.623s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Created reservations ['f1debeac-ed1c-4f17-ba01-2811b791e913'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:31 devstack cinder-volume[86721]: WARNING cinder.quota [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1650079470 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1650079470, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:53:31 devstack cinder-volume[86721]: WARNING cinder.quota [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1650079470 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1650079470, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Created reservations ['fd5eb33e-ca53-4b61-8e04-f53ae570e002', '6efaa22e-15af-47fc-b7f7-a6a24cf81c3b', '9a97736b-283d-4470-9ecc-c2eee2ddeab4', 'e5a9a270-0f1e-4ed0-9379-c530da9c642a'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:31 devstack sudo[95353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:31 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:31 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 1073741824" returned: 0 in 0.953s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:31 devstack sudo[95355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54
Jul 06 20:53:31 devstack sudo[95355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:32 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.758s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a5f2d861-e087-4a5a-9607-8fe1285207a2 tempest-GroupsV314Test-377242029 None] Delete group completed successfully.
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Acquiring lock "cinder-quobyte-05b02c5b-30f0-4ab8-a555-a45bb27c730d" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-05b02c5b-30f0-4ab8-a555-a45bb27c730d" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e5fd0-8f49-4276-b410-37409594441f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:32 devstack sudo[95355]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54" returned: 0 in 0.810s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e52d269-55e6-43bb-806b-3ebfa9edfbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a583e719-3c69-4b0c-8419-1d2c267b9a54', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0450210-fd15-4fc5-98b5-0c7c5aafde4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:32 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 (a583e719-3c69-4b0c-8419-1d2c267b9a54): created successfully
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0450210-fd15-4fc5-98b5-0c7c5aafde4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (20502fe4-8d6b-4898-9c88-426d57480125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-be7d0588-c7fe-4eb8-bbe7-fcc06194c108 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created volume successfully.
Jul 06 20:53:32 devstack sudo[95359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d
Jul 06 20:53:32 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:33 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d" returned: 0 in 0.855s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:33 devstack sudo[95367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d
Jul 06 20:53:33 devstack sudo[95367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Creating offline snapshot a7cc557e-e7ad-4621-ab78-91b7c9aadb25 of volume a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:53:33 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c977a3-bfde-418c-821f-d86d51aaf7d4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:34 devstack sudo[95370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54
Jul 06 20:53:34 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:34 devstack sudo[95367]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-05b02c5b-30f0-4ab8-a555-a45bb27c730d" returned: 0 in 0.826s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Lock "cinder-quobyte-05b02c5b-30f0-4ab8-a555-a45bb27c730d" released by "delete_volume" :: held 1.760s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Created reservations ['dcaf897d-4e26-4324-8585-82f6bde34d97'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Created reservations ['63724465-8c6a-4799-b59b-384a286dea61', 'f37c14d3-c1a4-4f35-9e98-45b7e7add297', 'c3085a3c-33e2-4053-a51f-009f1b4369d1', 'c45c4653-cdf1-4fbe-9729-b765cc35ec52'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:34 devstack sudo[95373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:34 devstack sudo[95373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Flow 'volume_create_manager' (1ed68c02-ceb8-4958-86ae-3aa830d71121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068525b9-991c-4769-8d6b-c38687374ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (068525b9-991c-4769-8d6b-c38687374ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-940445252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf673b-4377-4505-8676-2eeb4f12a372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b855a0dca0437ca9bedc25444d8557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:35Z,use_quota=True,user_id='87f326d2051b40138255c18ccb9d8825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000b0351-078c-44b6-871e-e33e96c9c023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (000b0351-078c-44b6-871e-e33e96c9c023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc5781-52c5-4e4d-99b2-9fae561f99c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41bc5781-52c5-4e4d-99b2-9fae561f99c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ecf673b-4377-4505-8676-2eeb4f12a372', 'volume_name': 'volume-0ecf673b-4377-4505-8676-2eeb4f12a372', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b44b19-17aa-473c-a373-f3a444d8b691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5b44b19-17aa-473c-a373-f3a444d8b691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82d6897-09df-4e9e-86ba-60af2973e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:34 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Volume 0ecf673b-4377-4505-8676-2eeb4f12a372: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ecf673b-4377-4505-8676-2eeb4f12a372', 'volume_size': 1}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:34 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54" returned: 0 in 0.898s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:34 devstack sudo[95379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 1G
Jul 06 20:53:34 devstack sudo[95379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:35 devstack sudo[95373]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.780s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:35 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d5f73061-a5f4-4234-97fd-dc3cdb77e0f0 tempest-GroupsV314Test-377242029 None] Delete group completed successfully.
Jul 06 20:53:35 devstack sudo[95379]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 1G" returned: 0 in 0.928s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:35 devstack sudo[95386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25
Jul 06 20:53:35 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:36 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25" returned: 0 in 0.817s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:36 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 is being set with open permissions: ugo+rw
Jul 06 20:53:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:36 devstack sudo[95391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25
Jul 06 20:53:36 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:37 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25" returned: 0 in 0.807s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=127,cinder:UPDATE=156,cinder:INSERT=44,cinder:DELETE=11 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:37 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.info
Jul 06 20:53:37 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:37 devstack sudo[95397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:37 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:38 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.info" returned: 0 in 0.881s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:38 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.info is being set with open permissions: ugo+rw
Jul 06 20:53:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:38 devstack sudo[95400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.info
Jul 06 20:53:38 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:38 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.910s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:53:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:53:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:53:39 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.info" returned: 0 in 0.877s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.320s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.406s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-940445252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ecf673b-4377-4505-8676-2eeb4f12a372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b855a0dca0437ca9bedc25444d8557',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:35Z,use_quota=True,user_id='87f326d2051b40138255c18ccb9d8825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Creating volume 0ecf673b-4377-4505-8676-2eeb4f12a372 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:39 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:39 devstack sudo[95405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372 1073741824
Jul 06 20:53:39 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:39 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0ee958e4-74d1-4b18-82e1-7138176a0455 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Create snapshot completed successfully
Jul 06 20:53:40 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372 1073741824" returned: 0 in 1.089s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:40 devstack sudo[95429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372
Jul 06 20:53:40 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (df8ef2ac-f40d-4595-bb7e-374511bf8f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5860f5b7-7c7d-4d8c-889d-c7a4d4fcc071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5860f5b7-7c7d-4d8c-889d-c7a4d4fcc071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494573987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ac4578-6b8a-4552-b44d-c23f5c55b7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:41Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4571104d-019a-4778-aca1-d5e2490a5612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4571104d-019a-4778-aca1-d5e2490a5612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531fd218-bc24-4689-b6e1-f237c0737ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (531fd218-bc24-4689-b6e1-f237c0737ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2ac4578-6b8a-4552-b44d-c23f5c55b7ac', 'volume_name': 'volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34008a05-e68f-4608-a756-48c8d193ab18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34008a05-e68f-4608-a756-48c8d193ab18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e31e3b9-efc4-4570-9b8d-2785f5e7bc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:40 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume d2ac4578-6b8a-4552-b44d-c23f5c55b7ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac', 'volume_size': 1}
Jul 06 20:53:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:41 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372" returned: 0 in 1.040s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] <== create_volume: return (2181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.442s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494573987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2ac4578-6b8a-4552-b44d-c23f5c55b7ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:41Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Creating volume d2ac4578-6b8a-4552-b44d-c23f5c55b7ac {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:41 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (44991784-9b49-4548-b976-10850e9c3a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:41 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac 1073741824
Jul 06 20:53:41 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89c68d2-0fa9-43ac-a90b-51a2fcd22b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c82d6897-09df-4e9e-86ba-60af2973e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ecf673b-4377-4505-8676-2eeb4f12a372', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f139ad3c-e001-471e-939a-77b44d824329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89c68d2-0fa9-43ac-a90b-51a2fcd22b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-596964134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d596c6e6-f0f0-4646-afa0-05fb0097f637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:41Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984186a-f0c2-4709-893c-f804123e372d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1984186a-f0c2-4709-893c-f804123e372d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e0b624-049c-4548-8b62-2dc31f4b749f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80e0b624-049c-4548-8b62-2dc31f4b749f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd596c6e6-f0f0-4646-afa0-05fb0097f637', 'volume_name': 'volume-d596c6e6-f0f0-4646-afa0-05fb0097f637', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941a3ff7-bca3-4ddc-9d6f-0dca129be2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (941a3ff7-bca3-4ddc-9d6f-0dca129be2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aeee55-f59e-49d4-b6e6-762e57c6caea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume d596c6e6-f0f0-4646-afa0-05fb0097f637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d596c6e6-f0f0-4646-afa0-05fb0097f637', 'volume_size': 1}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Volume volume-0ecf673b-4377-4505-8676-2eeb4f12a372 (0ecf673b-4377-4505-8676-2eeb4f12a372): created successfully
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f139ad3c-e001-471e-939a-77b44d824329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Flow 'volume_create_manager' (1ed68c02-ceb8-4958-86ae-3aa830d71121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6b461abc-145e-4ed6-bffb-df1c1a09f60a tempest-AttachVolumeTestJSON-1874748075 None] Created volume successfully.
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (e4375fb3-9a84-486b-8c1f-e426f90422b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c17629-8f1b-46c7-82e2-d9cb07c7c1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22c17629-8f1b-46c7-82e2-d9cb07c7c1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402420598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75ce5de-32c3-4f9b-8100-c4ccaa0461b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:42Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e380de7-272a-4e22-951a-ec201b6f7bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e380de7-272a-4e22-951a-ec201b6f7bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94cf8e2-0735-474d-9b34-74c2111ad1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94cf8e2-0735-474d-9b34-74c2111ad1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c75ce5de-32c3-4f9b-8100-c4ccaa0461b8', 'volume_name': 'volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9671d183-9ff9-457d-81e8-94f11ccf9204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9671d183-9ff9-457d-81e8-94f11ccf9204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7270d8-4555-4458-acd2-83472aef25f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume c75ce5de-32c3-4f9b-8100-c4ccaa0461b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8', 'volume_size': 1}
Jul 06 20:53:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (29dd3e7e-dc53-47a8-b89b-1c5f345cd21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7801bdf0-2962-4fa8-862c-3913d167edfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7801bdf0-2962-4fa8-862c-3913d167edfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96814877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea855a5-8ff1-43a0-9fc1-97d9249aa435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:42Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3e3503-f5cc-4a81-bfce-3a0652e54ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef3e3503-f5cc-4a81-bfce-3a0652e54ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e334a8c9-d176-4085-8507-021e7683dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e334a8c9-d176-4085-8507-021e7683dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fea855a5-8ff1-43a0-9fc1-97d9249aa435', 'volume_name': 'volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8e94c1-6ae3-421d-ba97-dbf989e0f585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8e94c1-6ae3-421d-ba97-dbf989e0f585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7981aa99-7b2d-411d-9530-f86772d14275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:42 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume fea855a5-8ff1-43a0-9fc1-97d9249aa435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435', 'volume_size': 1}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:42 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (b78b933d-05ae-4bec-85eb-c48be10b2453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a019fa-171c-47bf-b2f4-9d7f0e6eb06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac 1073741824" returned: 0 in 1.598s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6a019fa-171c-47bf-b2f4-9d7f0e6eb06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830263394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a256417-3fa0-4ee4-b361-89143cc50268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:43Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b9bc5a-bf09-45f6-b686-f89b723c1c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b9bc5a-bf09-45f6-b686-f89b723c1c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a9d5f7-7369-4966-b571-56a65f15673d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68a9d5f7-7369-4966-b571-56a65f15673d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a256417-3fa0-4ee4-b361-89143cc50268', 'volume_name': 'volume-0a256417-3fa0-4ee4-b361-89143cc50268', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5134bd20-b48c-464c-b443-79ac02f741bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5134bd20-b48c-464c-b443-79ac02f741bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7ee695-e81c-4c52-8927-1f051b9d085c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume 0a256417-3fa0-4ee4-b361-89143cc50268: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a256417-3fa0-4ee4-b361-89143cc50268', 'volume_size': 1}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:43 devstack sudo[95445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac
Jul 06 20:53:43 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:43 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac" returned: 0 in 0.652s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] <== create_volume: return (2359ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.363s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.185s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-596964134',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d596c6e6-f0f0-4646-afa0-05fb0097f637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:41Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Creating volume d596c6e6-f0f0-4646-afa0-05fb0097f637 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:43 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e31e3b9-efc4-4570-9b8d-2785f5e7bc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af6cd34-208e-42e0-8c20-3238e7f06aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:43 devstack sudo[95448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637 1073741824
Jul 06 20:53:43 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac (d2ac4578-6b8a-4552-b44d-c23f5c55b7ac): created successfully
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af6cd34-208e-42e0-8c20-3238e7f06aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (df8ef2ac-f40d-4595-bb7e-374511bf8f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-90fd77de-f91a-4c69-ad2c-5327072217e2 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created volume successfully.
Jul 06 20:53:45 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637 1073741824" returned: 0 in 1.484s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:45 devstack sudo[95500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637
Jul 06 20:53:45 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-36b65ed4-53cc-4be4-a9f9-ef34ea291ffd req-3105fa66-cf44-438b-8ff4-7db763b4b91f tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:46 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637" returned: 0 in 0.881s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] <== create_volume: return (2411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.415s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.179s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-402420598',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c75ce5de-32c3-4f9b-8100-c4ccaa0461b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:42Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Creating volume c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:46 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:46 devstack sudo[95530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 1073741824
Jul 06 20:53:46 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12aeee55-f59e-49d4-b6e6-762e57c6caea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d596c6e6-f0f0-4646-afa0-05fb0097f637', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009d2971-569f-4d49-bea7-29cf9d2c11ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:46 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume volume-d596c6e6-f0f0-4646-afa0-05fb0097f637 (d596c6e6-f0f0-4646-afa0-05fb0097f637): created successfully
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (009d2971-569f-4d49-bea7-29cf9d2c11ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (44991784-9b49-4548-b976-10850e9c3a95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a5a5ee77-7e2d-45a7-b870-dfa6ede1554d tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created volume successfully.
Jul 06 20:53:47 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 1073741824" returned: 0 in 1.022s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:47 devstack sudo[95538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8
Jul 06 20:53:47 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:48 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8" returned: 0 in 0.931s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] <== create_volume: return (2039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.633s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-96814877',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fea855a5-8ff1-43a0-9fc1-97d9249aa435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:42Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Creating volume fea855a5-8ff1-43a0-9fc1-97d9249aa435 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:48 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:48 devstack sudo[95542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435 1073741824
Jul 06 20:53:48 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7270d8-4555-4458-acd2-83472aef25f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ee1f7b-7a70-4a59-87e4-4a96640dfca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:48 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 (c75ce5de-32c3-4f9b-8100-c4ccaa0461b8): created successfully
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96ee1f7b-7a70-4a59-87e4-4a96640dfca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (e4375fb3-9a84-486b-8c1f-e426f90422b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b3493eb5-f2c6-46da-aa3a-25c08a4652b5 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created volume successfully.
Jul 06 20:53:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f19bb6c9-7b54-4a88-8083-d962fc5d0937 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373" by "attach_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f19bb6c9-7b54-4a88-8083-d962fc5d0937 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373" acquired by "attach_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f19bb6c9-7b54-4a88-8083-d962fc5d0937 tempest-VolumesActionsTest-2000099908 None] Attaching volume 1674415f-6318-4756-a9f0-c6453ecfc373 to instance f6bb5149-582a-42bd-8ab9-db62f5320644 at mountpoint /dev/vdb on host None.
Jul 06 20:53:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f19bb6c9-7b54-4a88-8083-d962fc5d0937 tempest-VolumesActionsTest-2000099908 None] Attach volume completed successfully.
Jul 06 20:53:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f19bb6c9-7b54-4a88-8083-d962fc5d0937 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373" released by "attach_volume" :: held 0.147s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:49 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435 1073741824" returned: 0 in 1.307s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:49 devstack sudo[95572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435
Jul 06 20:53:49 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4455e468-08f4-4047-a531-574ec06731b0 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-detach_volume" by "detach_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4455e468-08f4-4047-a531-574ec06731b0 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4455e468-08f4-4047-a531-574ec06731b0 tempest-VolumesActionsTest-2000099908 None] Detaching volume 1674415f-6318-4756-a9f0-c6453ecfc373 from instance f6bb5149-582a-42bd-8ab9-db62f5320644.
Jul 06 20:53:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4455e468-08f4-4047-a531-574ec06731b0 tempest-VolumesActionsTest-2000099908 None] Detach volume completed successfully.
Jul 06 20:53:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4455e468-08f4-4047-a531-574ec06731b0 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:50 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435" returned: 0 in 0.716s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.256s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1830263394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a256417-3fa0-4ee4-b361-89143cc50268,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3a0d921a2bd435996f7a6de63388e5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:43Z,use_quota=True,user_id='9a5d62e7f5d34b3e9905faab2d997b67',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Creating volume 0a256417-3fa0-4ee4-b361-89143cc50268 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:50 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7981aa99-7b2d-411d-9530-f86772d14275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:50 devstack sudo[95575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268 1073741824
Jul 06 20:53:50 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2d438e-2460-4b07-bb3b-21b636dd29d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435 (fea855a5-8ff1-43a0-9fc1-97d9249aa435): created successfully
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2d438e-2460-4b07-bb3b-21b636dd29d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (29dd3e7e-dc53-47a8-b89b-1c5f345cd21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:50 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6f4f684c-da8b-4c72-9d50-1ef73ec3e48b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created volume successfully.
Jul 06 20:53:51 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268 1073741824" returned: 0 in 1.065s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:51 devstack sudo[95582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268
Jul 06 20:53:51 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:52 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268" returned: 0 in 0.777s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-36b65ed4-53cc-4be4-a9f9-ef34ea291ffd req-3105fa66-cf44-438b-8ff4-7db763b4b91f tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.676s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7ee695-e81c-4c52-8927-1f051b9d085c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a256417-3fa0-4ee4-b361-89143cc50268', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb50340c-fab6-422c-a77f-d8713e5541dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c278bc3-490e-44f2-9802-d864c1742872]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-36b65ed4-53cc-4be4-a9f9-ef34ea291ffd req-3105fa66-cf44-438b-8ff4-7db763b4b91f tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:52 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Volume volume-0a256417-3fa0-4ee4-b361-89143cc50268 (0a256417-3fa0-4ee4-b361-89143cc50268): created successfully
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb50340c-fab6-422c-a77f-d8713e5541dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Flow 'volume_create_manager' (b78b933d-05ae-4bec-85eb-c48be10b2453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-da653430-9dc2-417a-aa24-5f76a57a0891 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created volume successfully.
Jul 06 20:53:52 devstack sudo[95590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372
Jul 06 20:53:52 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-0a256417-3fa0-4ee4-b361-89143cc50268-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:52 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-0a256417-3fa0-4ee4-b361-89143cc50268-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-0a256417-3fa0-4ee4-b361-89143cc50268" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-0a256417-3fa0-4ee4-b361-89143cc50268" acquired by "delete_volume" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:53 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b3abf3-bc12-4aeb-a2cc-8ed14a56ad8f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:53 devstack sudo[95608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268
Jul 06 20:53:53 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:53 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-36b65ed4-53cc-4be4-a9f9-ef34ea291ffd req-3105fa66-cf44-438b-8ff4-7db763b4b91f tempest-AttachVolumeTestJSON-1874748075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372" returned: 0 in 1.442s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-36b65ed4-53cc-4be4-a9f9-ef34ea291ffd req-3105fa66-cf44-438b-8ff4-7db763b4b91f tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.491s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-36b65ed4-53cc-4be4-a9f9-ef34ea291ffd req-3105fa66-cf44-438b-8ff4-7db763b4b91f tempest-AttachVolumeTestJSON-1874748075 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-0ecf673b-4377-4505-8676-2eeb4f12a372', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf44597c-97d4-4eeb-844f-c00222634de3', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:53:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-36b65ed4-53cc-4be4-a9f9-ef34ea291ffd req-3105fa66-cf44-438b-8ff4-7db763b4b91f tempest-AttachVolumeTestJSON-1874748075 None] attachment_update completed successfully.
Jul 06 20:53:54 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268" returned: 0 in 1.156s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:54 devstack sudo[95619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268
Jul 06 20:53:54 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:55 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0a256417-3fa0-4ee4-b361-89143cc50268" returned: 0 in 0.720s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-0a256417-3fa0-4ee4-b361-89143cc50268" released by "delete_volume" :: held 1.966s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created reservations ['576a0ee1-7d5d-43bc-bf46-1663d3acc0c0', 'c157baef-23a9-42ca-8687-7784dc415c94', '56048778-54b4-46f7-b20a-b73986cd45e0', '568223e1-4b51-4ce8-bfbd-6296fab882b4'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:55 devstack sudo[95625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:55 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-fea855a5-8ff1-43a0-9fc1-97d9249aa435-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-fea855a5-8ff1-43a0-9fc1-97d9249aa435-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-fea855a5-8ff1-43a0-9fc1-97d9249aa435" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-fea855a5-8ff1-43a0-9fc1-97d9249aa435" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9936ff8-6a3b-484d-bd26-250e02c9eb0b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:55 devstack sudo[95627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435
Jul 06 20:53:55 devstack sudo[95627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:56 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.870s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:56 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Deleted volume successfully.
Jul 06 20:53:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5993225a-e12d-4552-9344-5f7d2ffac146 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-0a256417-3fa0-4ee4-b361-89143cc50268-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:56 devstack sudo[95627]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435" returned: 0 in 0.888s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:56 devstack sudo[95635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435
Jul 06 20:53:56 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:57 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fea855a5-8ff1-43a0-9fc1-97d9249aa435" returned: 0 in 0.681s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-fea855a5-8ff1-43a0-9fc1-97d9249aa435" released by "delete_volume" :: held 1.634s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created reservations ['edbfd16d-a254-404e-bf2d-bbd00e1982c6', 'feae88fe-a70d-4c01-a218-c2a0f5489cec', 'b89515c0-ea76-4e6f-b21a-142635a47698', 'af4e9cf2-daea-464c-bd7b-60806b7df197'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:57 devstack sudo[95638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:53:57 devstack sudo[95638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6200ba22-d22b-42d9-a2a1-c937ce3b9576]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:53:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:58 devstack sudo[95643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8
Jul 06 20:53:58 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Flow 'volume_create_manager' (0488763b-dd6e-41df-a81d-c72006ffaf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ad5aa3-e3a7-4078-b997-364404461525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5ad5aa3-e3a7-4078-b997-364404461525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-593688561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a155de-21ab-4fef-b1bf-7ee337a97c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe96f49457c54c489a9897072acfab39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:58Z,use_quota=True,user_id='f98c837ebfad46cd95ba728e88fc7b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd71850c-aa73-41a9-9958-e2bbbfa7c2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd71850c-aa73-41a9-9958-e2bbbfa7c2b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149cc8eb-870f-4aa8-bf41-009654a749a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (149cc8eb-870f-4aa8-bf41-009654a749a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3a155de-21ab-4fef-b1bf-7ee337a97c04', 'volume_name': 'volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77720246-496d-4289-b790-27821b8782a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77720246-496d-4289-b790-27821b8782a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace9bef-81d6-4130-8256-1badc19043fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:53:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Volume e3a155de-21ab-4fef-b1bf-7ee337a97c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04', 'volume_size': 1}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-593688561',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3a155de-21ab-4fef-b1bf-7ee337a97c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe96f49457c54c489a9897072acfab39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:53:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:53:58Z,use_quota=True,user_id='f98c837ebfad46cd95ba728e88fc7b97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Creating volume e3a155de-21ab-4fef-b1bf-7ee337a97c04 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:53:58 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:58 devstack sudo[95638]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.996s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:53:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Deleted volume successfully.
Jul 06 20:53:58 devstack sudo[95646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04 1073741824
Jul 06 20:53:58 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bbe232da-5a4f-49ae-a248-a5eb277099ec tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-fea855a5-8ff1-43a0-9fc1-97d9249aa435-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:59 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8" returned: 0 in 1.072s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:59 devstack sudo[95658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8
Jul 06 20:53:59 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:59 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04 1073741824" returned: 0 in 1.022s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:53:59 devstack sudo[95661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04
Jul 06 20:53:59 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:53:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-abdb0250-63ea-4d76-9d60-dd366808c6cb req-d2c6c4f8-f0d0-4baa-b3aa-91e139cc191d tempest-AttachVolumeTestJSON-1874748075 None] Terminate volume connection completed successfully.
Jul 06 20:53:59 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-abdb0250-63ea-4d76-9d60-dd366808c6cb req-d2c6c4f8-f0d0-4baa-b3aa-91e139cc191d tempest-AttachVolumeTestJSON-1874748075 None] Deleting attachment 9f536407-9bcc-420a-82df-e6ebd0f33b4d. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8" returned: 0 in 0.822s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8" released by "delete_volume" :: held 1.978s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created reservations ['bde88bd1-d7e3-4195-95f6-59ebce85b7dc', '84d666d4-4f57-488e-8e4b-67e2a454c378', '346cba21-c21e-42df-8359-3bb153e02984', 'f36e9a93-612b-4456-a37d-2558893ea08a'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:53:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:00 devstack sudo[95669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:00 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:00 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04" returned: 0 in 0.739s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ace9bef-81d6-4130-8256-1badc19043fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7ab059-acf6-4c93-a5b9-bafeae483acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Volume volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04 (e3a155de-21ab-4fef-b1bf-7ee337a97c04): created successfully
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7ab059-acf6-4c93-a5b9-bafeae483acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Flow 'volume_create_manager' (0488763b-dd6e-41df-a81d-c72006ffaf24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-dcd2d5b3-a2a6-416b-9d9b-c80d014dbf31 tempest-VolumesServicesTestJSON-1342105552 None] Created volume successfully.
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-d596c6e6-f0f0-4646-afa0-05fb0097f637-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-d596c6e6-f0f0-4646-afa0-05fb0097f637-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-d596c6e6-f0f0-4646-afa0-05fb0097f637" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-d596c6e6-f0f0-4646-afa0-05fb0097f637" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1515435d-9d24-467c-89f5-fc9622540fe5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:00 devstack sudo[95671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637
Jul 06 20:54:00 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:00 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.803s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Deleted volume successfully.
Jul 06 20:54:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ff4ab207-17a1-4685-9c1c-c301353300a3 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-c75ce5de-32c3-4f9b-8100-c4ccaa0461b8-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:01 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637" returned: 0 in 0.799s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:01 devstack sudo[95678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637
Jul 06 20:54:01 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Acquiring lock "cinder-e3a155de-21ab-4fef-b1bf-7ee337a97c04-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Lock "cinder-e3a155de-21ab-4fef-b1bf-7ee337a97c04-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Acquiring lock "cinder-quobyte-e3a155de-21ab-4fef-b1bf-7ee337a97c04" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Lock "cinder-quobyte-e3a155de-21ab-4fef-b1bf-7ee337a97c04" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80471a1-9a22-4d88-b381-ac1f3b83285a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:01 devstack sudo[95680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04
Jul 06 20:54:01 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:01 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d596c6e6-f0f0-4646-afa0-05fb0097f637" returned: 0 in 0.706s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-d596c6e6-f0f0-4646-afa0-05fb0097f637" released by "delete_volume" :: held 1.554s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created reservations ['5b70e5a3-8442-4454-8894-2e6bdc2d8064', '33001b9e-c42b-420c-9f73-45fa9798a1ea', 'dd896b6b-bd59-4db5-9621-9f97a765de50', '3859c522-2734-4cf1-8aca-30060f011e38'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:01 devstack sudo[95683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:01 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:02 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04" returned: 0 in 0.838s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:02 devstack sudo[95693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04
Jul 06 20:54:02 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:02 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-582d1d61-4892-4932-bb27-51fd001b7c5f req-9004927e-9912-4933-9e2d-95bb8889d020 tempest-AttachVolumeTestJSON-1874748075 None] Terminate volume connection completed successfully.
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-582d1d61-4892-4932-bb27-51fd001b7c5f req-9004927e-9912-4933-9e2d-95bb8889d020 tempest-AttachVolumeTestJSON-1874748075 None] Deleting attachment bf44597c-97d4-4eeb-844f-c00222634de3. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab8878a-11af-4cdd-8a25-2a3b3c3576c4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:02 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.823s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:02 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Deleted volume successfully.
Jul 06 20:54:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c22a10a9-f31c-492d-8eee-4240af7ada58 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-d596c6e6-f0f0-4646-afa0-05fb0097f637-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:02 devstack sudo[95696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac
Jul 06 20:54:02 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:03 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e3a155de-21ab-4fef-b1bf-7ee337a97c04" returned: 0 in 0.816s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Lock "cinder-quobyte-e3a155de-21ab-4fef-b1bf-7ee337a97c04" released by "delete_volume" :: held 1.713s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Created reservations ['88c1cea1-4240-4d40-a90e-fdc2782acc11', '548a9862-2e83-4ae8-9cd6-9d4c4ac2b8ea', 'f0c87531-efaf-4e13-9260-9de263314bca', 'f0895cc9-a36f-400f-9d23-7d651a38f0c3'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:03 devstack sudo[95702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:03 devstack sudo[95702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:03 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac" returned: 0 in 0.770s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:03 devstack sudo[95704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac
Jul 06 20:54:03 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:04 devstack sudo[95702]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.984s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:04 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Deleted volume successfully.
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62cf0f71-fca0-433d-a754-40448d208d34 tempest-VolumesServicesTestJSON-1342105552 None] Lock "cinder-e3a155de-21ab-4fef-b1bf-7ee337a97c04-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:04 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac" returned: 0 in 1.133s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac" released by "delete_volume" :: held 1.998s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created reservations ['40d4ca09-2cbc-4e97-98e6-49aea4aa60dd', 'f8dec2c7-fa81-4cdd-95d0-9c8348770b94', '4df1cf45-bd3a-4e67-a286-fa1b7254e302', '05c1cb8a-84ea-4a2d-b1e9-e5f6bac561b7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:04 devstack sudo[95745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:04 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:05 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.926s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:05 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Deleted volume successfully.
Jul 06 20:54:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-91c3ceab-defb-4896-8e43-d69fcaaa1a2b tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-d2ac4578-6b8a-4552-b44d-c23f5c55b7ac-delete_volume" released by "delete_volume" :: held 3.323s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-a7cc557e-e7ad-4621-ab78-91b7c9aadb25-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-a7cc557e-e7ad-4621-ab78-91b7c9aadb25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-a583e719-3c69-4b0c-8419-1d2c267b9a54" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-a583e719-3c69-4b0c-8419-1d2c267b9a54" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-a7cc557e-e7ad-4621-ab78-91b7c9aadb25" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-a7cc557e-e7ad-4621-ab78-91b7c9aadb25" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Deleting offline snapshot a7cc557e-e7ad-4621-ab78-91b7c9aadb25 of volume a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] snapshot_file for this snap is: volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf082fb-6400-46d5-bf7b-f50464068f69]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:06 devstack sudo[95756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25
Jul 06 20:54:06 devstack sudo[95756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:07 devstack sudo[95756]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25" returned: 0 in 0.893s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a583e719-3c69-4b0c-8419-1d2c267b9a54(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:54:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbce519d-2d10-42f4-b3a5-d08acc619df8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:07 devstack sudo[95780]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54
Jul 06 20:54:07 devstack sudo[95780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:08 devstack sudo[95780]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54" returned: 0 in 1.099s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:08 devstack sudo[95804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25
Jul 06 20:54:08 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:09 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25" returned: 0 in 1.181s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:09 devstack sudo[95812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25
Jul 06 20:54:09 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:10 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54.a7cc557e-e7ad-4621-ab78-91b7c9aadb25" returned: 0 in 0.718s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-a7cc557e-e7ad-4621-ab78-91b7c9aadb25" released by "_delete_snapshot" :: held 4.044s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-a583e719-3c69-4b0c-8419-1d2c267b9a54" released by "delete_snapshot" :: held 4.078s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:10 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created reservations ['90116348-8876-42b7-b801-dcc613f9837d', '0d17f78c-71f6-4501-830a-a19103e0c148', 'c3432762-6794-4083-b723-ab172c67437e', 'dedf863e-a234-443a-884f-030477ff75d3'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Delete snapshot completed successfully.
Jul 06 20:54:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0c5fdabd-b054-4ead-980e-f42facb39d38 tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-a7cc557e-e7ad-4621-ab78-91b7c9aadb25-delete_snapshot" released by "delete_snapshot" :: held 4.280s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-a583e719-3c69-4b0c-8419-1d2c267b9a54-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-a583e719-3c69-4b0c-8419-1d2c267b9a54-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "cinder-quobyte-a583e719-3c69-4b0c-8419-1d2c267b9a54" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-a583e719-3c69-4b0c-8419-1d2c267b9a54" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:11 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[daed5f27-9367-40d1-95cd-b3a5db126a58]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:11 devstack sudo[95861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54
Jul 06 20:54:11 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:12 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54" returned: 0 in 0.878s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:12 devstack sudo[95885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54
Jul 06 20:54:12 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:13 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a583e719-3c69-4b0c-8419-1d2c267b9a54" returned: 0 in 0.957s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-quobyte-a583e719-3c69-4b0c-8419-1d2c267b9a54" released by "delete_volume" :: held 1.920s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Created reservations ['dde60d46-d440-4a10-833f-93d0b5c43156', '4836a664-92f9-4b9b-9bb4-b086341681a6', '31788e16-bdc6-483b-9169-492a41edaa45', '89fc7552-1a11-490e-b7f7-549064e897af'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:13 devstack sudo[95890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:13 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "cinder-0ecf673b-4377-4505-8676-2eeb4f12a372-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-0ecf673b-4377-4505-8676-2eeb4f12a372-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "cinder-quobyte-0ecf673b-4377-4505-8676-2eeb4f12a372" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-quobyte-0ecf673b-4377-4505-8676-2eeb4f12a372" acquired by "delete_volume" :: waited 0.038s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d937663d-cd10-4e42-955c-d69ddf660ad8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:15 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.459s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:15 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Deleted volume successfully.
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f3d30e3-fb55-44f9-b550-3b327442c28c tempest-CreateVolumesFromSnapshotTest-1425417560 None] Lock "cinder-a583e719-3c69-4b0c-8419-1d2c267b9a54-delete_volume" released by "delete_volume" :: held 3.855s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:15 devstack sudo[95893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372
Jul 06 20:54:15 devstack sudo[95893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5b722b56-9771-40ba-b817-71b206ffe864 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373" by "attach_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5b722b56-9771-40ba-b817-71b206ffe864 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373" acquired by "attach_volume" :: waited 0.053s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:15 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5b722b56-9771-40ba-b817-71b206ffe864 tempest-VolumesActionsTest-2000099908 None] Attaching volume 1674415f-6318-4756-a9f0-c6453ecfc373 to instance c6094ae2-0b43-491f-abb4-c9bec4750a43 at mountpoint /dev/vdb on host None.
Jul 06 20:54:15 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5b722b56-9771-40ba-b817-71b206ffe864 tempest-VolumesActionsTest-2000099908 None] Attach volume completed successfully.
Jul 06 20:54:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5b722b56-9771-40ba-b817-71b206ffe864 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373" released by "attach_volume" :: held 0.222s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9d5c3e09-d1a4-4452-bdc2-4def2a0950a5 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-detach_volume" by "detach_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9d5c3e09-d1a4-4452-bdc2-4def2a0950a5 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9d5c3e09-d1a4-4452-bdc2-4def2a0950a5 tempest-VolumesActionsTest-2000099908 None] Detaching volume 1674415f-6318-4756-a9f0-c6453ecfc373 from instance c6094ae2-0b43-491f-abb4-c9bec4750a43.
Jul 06 20:54:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9d5c3e09-d1a4-4452-bdc2-4def2a0950a5 tempest-VolumesActionsTest-2000099908 None] Detach volume completed successfully.
Jul 06 20:54:16 devstack sudo[95893]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9d5c3e09-d1a4-4452-bdc2-4def2a0950a5 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-detach_volume" released by "detach_volume" :: held 0.124s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372" returned: 0 in 1.336s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:16 devstack sudo[95898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372
Jul 06 20:54:16 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:17 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0ecf673b-4377-4505-8676-2eeb4f12a372" returned: 0 in 1.221s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-quobyte-0ecf673b-4377-4505-8676-2eeb4f12a372" released by "delete_volume" :: held 2.675s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Created reservations ['c1d4953f-5f13-46ae-a05d-07420587dfc6', 'cda085cc-82f9-4204-a4a6-6e3b43a552e4', '7a82b4d2-4ea8-4b07-a022-0edafbd880b4', 'd1865977-85ed-4254-b84f-9fb1cd643d2c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:17 devstack sudo[95903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:17 devstack sudo[95903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "cinder-1298f582-8aff-437c-be6b-20ead1aebde2-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-1298f582-8aff-437c-be6b-20ead1aebde2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "cinder-quobyte-1298f582-8aff-437c-be6b-20ead1aebde2" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-quobyte-1298f582-8aff-437c-be6b-20ead1aebde2" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aeec8b-1fa8-4a2e-a2a9-6d01079eb686]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:18 devstack sudo[95910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2
Jul 06 20:54:18 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:18 devstack sudo[95903]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.878s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Deleted volume successfully.
Jul 06 20:54:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d8ac6ea6-dec1-4a81-b180-888431e2d5d0 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-0ecf673b-4377-4505-8676-2eeb4f12a372-delete_volume" released by "delete_volume" :: held 3.932s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (88b8c9aa-aee1-4c81-8fd3-d3b08da81782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a16869-d625-4fa7-9b59-6aeaa886362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a16869-d625-4fa7-9b59-6aeaa886362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1340238168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded1db4c-22b0-4893-ade1-c2145bbe51fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:20Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8df23c7-ae38-4f7d-9290-e4fbb68b3725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8df23c7-ae38-4f7d-9290-e4fbb68b3725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8be852-0d56-4a53-9965-9ab4ab971cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a8be852-0d56-4a53-9965-9ab4ab971cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ded1db4c-22b0-4893-ade1-c2145bbe51fa', 'volume_name': 'volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00f2e87-7fcc-45ad-aa42-9cd195cdee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:19 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d00f2e87-7fcc-45ad-aa42-9cd195cdee8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86e903b-c5e1-4ea6-b876-b3183dcb2cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:19 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume ded1db4c-22b0-4893-ade1-c2145bbe51fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa', 'volume_size': 1}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1340238168',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ded1db4c-22b0-4893-ade1-c2145bbe51fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:20Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Creating volume ded1db4c-22b0-4893-ade1-c2145bbe51fa {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:54:19 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2" returned: 0 in 1.294s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:19 devstack sudo[95933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa 1073741824
Jul 06 20:54:19 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:19 devstack sudo[95934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2
Jul 06 20:54:19 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:20 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1298f582-8aff-437c-be6b-20ead1aebde2" returned: 0 in 0.971s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-quobyte-1298f582-8aff-437c-be6b-20ead1aebde2" released by "delete_volume" :: held 2.329s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Created reservations ['450fc52a-8c94-432e-8858-3bbd1c7b848d', 'ccdd0b52-db5c-4599-a4d8-04346706e1e3', 'b82d7c49-d08d-4b01-82c3-f74f0a7bbd82', '01328317-1553-439b-8b03-636f50e88ba7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:20 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa 1073741824" returned: 0 in 1.147s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:20 devstack sudo[95951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:20 devstack sudo[95951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:20 devstack sudo[95953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa
Jul 06 20:54:20 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:21 devstack sudo[95951]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.861s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Deleted volume successfully.
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-03913d1e-a75b-4300-9c33-2d561648558e tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-1298f582-8aff-437c-be6b-20ead1aebde2-delete_volume" released by "delete_volume" :: held 3.441s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:21 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa" returned: 0 in 0.884s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c86e903b-c5e1-4ea6-b876-b3183dcb2cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da52862-2955-4343-9386-eee8564562ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:21 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa (ded1db4c-22b0-4893-ade1-c2145bbe51fa): created successfully
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2da52862-2955-4343-9386-eee8564562ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (88b8c9aa-aee1-4c81-8fd3-d3b08da81782) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5349e67d-a42e-49e1-9e8b-d6226779bff9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created volume successfully.
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "cinder-f0d6ea94-f95a-4055-a7c8-228df28198fb-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-f0d6ea94-f95a-4055-a7c8-228df28198fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "cinder-quobyte-f0d6ea94-f95a-4055-a7c8-228df28198fb" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-quobyte-f0d6ea94-f95a-4055-a7c8-228df28198fb" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:22 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b41a18-6742-4a07-a598-eb12d6ed61d8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:22 devstack sudo[95957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb
Jul 06 20:54:22 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:22 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb" returned: 0 in 0.848s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:22 devstack sudo[95962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb
Jul 06 20:54:22 devstack sudo[95962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Flow 'volume_create_manager' (36dfaf88-812a-4077-ad0f-3e410906385d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5672a610-d554-42b6-8c1e-d91901f11ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5672a610-d554-42b6-8c1e-d91901f11ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1287004062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c28abf8-eda7-4c46-9663-027edfff9150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e2e264c36b44d881933d9808543f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:23Z,use_quota=True,user_id='d0cf0e5990dd48eb8d6a6c670190d77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fa711a-ba87-48af-8fc1-8e7d89a3988e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01fa711a-ba87-48af-8fc1-8e7d89a3988e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d261b69-5f48-4a78-8aa7-c6d1ea1ff250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d261b69-5f48-4a78-8aa7-c6d1ea1ff250) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c28abf8-eda7-4c46-9663-027edfff9150', 'volume_name': 'volume-7c28abf8-eda7-4c46-9663-027edfff9150', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f540618f-ee7f-40cc-93a7-1168a9f2cf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f540618f-ee7f-40cc-93a7-1168a9f2cf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1969255a-8b0d-4ccb-97a3-c699185b0881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Volume 7c28abf8-eda7-4c46-9663-027edfff9150: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c28abf8-eda7-4c46-9663-027edfff9150', 'volume_size': 1}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1287004062',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c28abf8-eda7-4c46-9663-027edfff9150,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e2e264c36b44d881933d9808543f18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:23Z,use_quota=True,user_id='d0cf0e5990dd48eb8d6a6c670190d77f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Creating volume 7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:54:23 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:23 devstack sudo[95964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 1073741824
Jul 06 20:54:23 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (bfb8e363-070b-450a-8d4d-e9547330ee5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ba50eb-8808-41d5-bea2-7e6e25d93975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ba50eb-8808-41d5-bea2-7e6e25d93975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-33046172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62be267c-c328-43f4-a833-56c27dbc8994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:23Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aa562f-7f14-4ef7-a4b3-78b4fcd768b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64aa562f-7f14-4ef7-a4b3-78b4fcd768b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17731b2-19de-47a4-83e2-617ef6520959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17731b2-19de-47a4-83e2-617ef6520959) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62be267c-c328-43f4-a833-56c27dbc8994', 'volume_name': 'volume-62be267c-c328-43f4-a833-56c27dbc8994', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246dd4b7-a7af-409b-b7d7-ad8290336e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246dd4b7-a7af-409b-b7d7-ad8290336e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e527e943-0c7b-4c01-9a05-acab9d0e1507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume 62be267c-c328-43f4-a833-56c27dbc8994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62be267c-c328-43f4-a833-56c27dbc8994', 'volume_size': 1}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:23 devstack sudo[95962]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f0d6ea94-f95a-4055-a7c8-228df28198fb" returned: 0 in 0.765s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-quobyte-f0d6ea94-f95a-4055-a7c8-228df28198fb" released by "delete_volume" :: held 1.676s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Created reservations ['7c92084f-7e3a-4f7a-a416-92e3d3101621', '7370dd95-4ccb-40b3-a59b-6c00eb2fb2dc', 'e19c94f1-80ca-4caf-9586-7f0efbb36e68', '7e965d91-6d22-46a0-a2cc-881b400fef11'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (2fae099d-6eb6-4de6-8fdb-a5d727a03b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba7144-9a5c-43c5-9632-9cc1249789c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deba7144-9a5c-43c5-9632-9cc1249789c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241422504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6843c7-cb1e-4939-954b-66feee54e5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:24Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64245b05-1677-4de1-8268-af6c873566dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64245b05-1677-4de1-8268-af6c873566dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9833752d-ad07-4233-b78c-e2809b152ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9833752d-ad07-4233-b78c-e2809b152ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee6843c7-cb1e-4939-954b-66feee54e5a8', 'volume_name': 'volume-ee6843c7-cb1e-4939-954b-66feee54e5a8', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fc1a98-ca68-4568-a9c6-6a74c480ed15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6fc1a98-ca68-4568-a9c6-6a74c480ed15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d26ce36-c254-4f68-8990-d85dd753f606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume ee6843c7-cb1e-4939-954b-66feee54e5a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee6843c7-cb1e-4939-954b-66feee54e5a8', 'volume_size': 1}
Jul 06 20:54:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:24 devstack sudo[95970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:24 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:24 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 1073741824" returned: 0 in 1.336s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (702f285e-55f7-437f-91cc-212546790254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8113cfc5-6210-4963-b06c-70cbc0f736d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8113cfc5-6210-4963-b06c-70cbc0f736d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39928952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfd8370-00fa-4bf9-8120-926427c2491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:24Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e17965-6be5-45ad-a93a-6b27655a9a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e17965-6be5-45ad-a93a-6b27655a9a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca5c71c-298e-4cad-a6e7-7bbaedd6dac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca5c71c-298e-4cad-a6e7-7bbaedd6dac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dfd8370-00fa-4bf9-8120-926427c2491e', 'volume_name': 'volume-2dfd8370-00fa-4bf9-8120-926427c2491e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a97c40b-b424-45af-8603-cdf9677505f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a97c40b-b424-45af-8603-cdf9677505f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358b2b9d-7826-4895-ab51-85390d10d182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:24 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume 2dfd8370-00fa-4bf9-8120-926427c2491e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dfd8370-00fa-4bf9-8120-926427c2491e', 'volume_size': 1}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:24 devstack sudo[95973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150
Jul 06 20:54:24 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:54:25 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (50e06b81-f168-4059-9485-53e37bd286c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1fdc74-8fe1-4738-bdb1-4b185e145335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.333s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Deleted volume successfully.
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe1fdc74-8fe1-4738-bdb1-4b185e145335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211637409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f4de6a-2fd2-4883-9aec-85cf7bab4733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:25Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a521cf5b-5c5d-4809-a1fc-d484d0e9168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a521cf5b-5c5d-4809-a1fc-d484d0e9168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5c39d8-627e-451d-85cc-70d7642def58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5c39d8-627e-451d-85cc-70d7642def58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72f4de6a-2fd2-4883-9aec-85cf7bab4733', 'volume_name': 'volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f06444-a0b4-4dd0-8691-0ace3acb405e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f06444-a0b4-4dd0-8691-0ace3acb405e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d73d471-711b-41b8-989a-7f7c8fe93804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume 72f4de6a-2fd2-4883-9aec-85cf7bab4733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733', 'volume_size': 1}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a1f8a5d0-2014-44dc-afc8-2d25f2e19f50 tempest-AttachVolumeTestJSON-1874748075 None] Lock "cinder-f0d6ea94-f95a-4055-a7c8-228df28198fb-delete_volume" released by "delete_volume" :: held 3.540s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:25 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150" returned: 0 in 0.808s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-33046172',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62be267c-c328-43f4-a833-56c27dbc8994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:23Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Creating volume 62be267c-c328-43f4-a833-56c27dbc8994 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:54:25 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1969255a-8b0d-4ccb-97a3-c699185b0881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c28abf8-eda7-4c46-9663-027edfff9150', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089b2f4b-8f0b-43e4-97cc-de53af2701e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Volume volume-7c28abf8-eda7-4c46-9663-027edfff9150 (7c28abf8-eda7-4c46-9663-027edfff9150): created successfully
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089b2f4b-8f0b-43e4-97cc-de53af2701e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack sudo[95977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994 1073741824
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Flow 'volume_create_manager' (36dfaf88-812a-4077-ad0f-3e410906385d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:25 devstack sudo[95977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-60d4b156-14bf-4e8c-9045-69b90e1b5bf8 tempest-SnapshotMetadataTestJSON-490974576 None] Created volume successfully.
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (2fd417ba-318c-404d-8e20-e12eda38c68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aee91d5-fa84-45f0-b05f-042d354e9c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aee91d5-fa84-45f0-b05f-042d354e9c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235496203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959aa3c2-e047-46b3-8407-8f19c3a967f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:26Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3f29cc-f0dd-4c9a-8f69-b4e501886eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3f29cc-f0dd-4c9a-8f69-b4e501886eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fb6b15-2d50-45fc-ba08-bde36ff61c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6fb6b15-2d50-45fc-ba08-bde36ff61c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959aa3c2-e047-46b3-8407-8f19c3a967f5', 'volume_name': 'volume-959aa3c2-e047-46b3-8407-8f19c3a967f5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9108c1-e923-4448-b672-f0f84b5682aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b9108c1-e923-4448-b672-f0f84b5682aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f765a128-2675-4425-8bec-8697b0657c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume 959aa3c2-e047-46b3-8407-8f19c3a967f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959aa3c2-e047-46b3-8407-8f19c3a967f5', 'volume_size': 1}
Jul 06 20:54:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:26 devstack sudo[95977]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994 1073741824" returned: 0 in 1.218s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:26 devstack sudo[95984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994
Jul 06 20:54:26 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:27 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994" returned: 0 in 0.697s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.532s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-241422504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee6843c7-cb1e-4939-954b-66feee54e5a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:24Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Creating volume ee6843c7-cb1e-4939-954b-66feee54e5a8 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:54:27 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e527e943-0c7b-4c01-9a05-acab9d0e1507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62be267c-c328-43f4-a833-56c27dbc8994', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:27 devstack sudo[95988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8 1073741824
Jul 06 20:54:27 devstack sudo[95988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456897a5-967c-4ed3-bf01-85f821cb2fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:27 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume volume-62be267c-c328-43f4-a833-56c27dbc8994 (62be267c-c328-43f4-a833-56c27dbc8994): created successfully
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (456897a5-967c-4ed3-bf01-85f821cb2fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (bfb8e363-070b-450a-8d4d-e9547330ee5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:27 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-905f9cb2-a044-4793-a3b4-cc693d77e4de tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created volume successfully.
Jul 06 20:54:28 devstack sudo[95988]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8 1073741824" returned: 0 in 0.965s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:28 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=160,cinder:SELECT=130,cinder:DELETE=11,cinder:INSERT=28 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:54:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:28 devstack sudo[95994]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8
Jul 06 20:54:28 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:29 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8" returned: 0 in 0.725s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.556s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-39928952',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dfd8370-00fa-4bf9-8120-926427c2491e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:24Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Creating volume 2dfd8370-00fa-4bf9-8120-926427c2491e {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:54:29 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d26ce36-c254-4f68-8990-d85dd753f606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee6843c7-cb1e-4939-954b-66feee54e5a8', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:29 devstack sudo[95998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e 1073741824
Jul 06 20:54:29 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367addd8-7a70-4a7c-b398-d74bc2278a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:29 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume volume-ee6843c7-cb1e-4939-954b-66feee54e5a8 (ee6843c7-cb1e-4939-954b-66feee54e5a8): created successfully
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367addd8-7a70-4a7c-b398-d74bc2278a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (2fae099d-6eb6-4de6-8fdb-a5d727a03b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:29 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9a18206d-d5d2-444d-ae58-effa5a25ffc9 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created volume successfully.
Jul 06 20:54:30 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e 1073741824" returned: 0 in 0.935s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:30 devstack sudo[96004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e
Jul 06 20:54:30 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:30 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e" returned: 0 in 0.673s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.439s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-211637409',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f4de6a-2fd2-4883-9aec-85cf7bab4733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:25Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Creating volume 72f4de6a-2fd2-4883-9aec-85cf7bab4733 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:54:30 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (358b2b9d-7826-4895-ab51-85390d10d182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dfd8370-00fa-4bf9-8120-926427c2491e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:30 devstack sudo[96007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733 1073741824
Jul 06 20:54:30 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5140ca67-47f1-42ef-ba71-e0ea046fcfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:30 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume volume-2dfd8370-00fa-4bf9-8120-926427c2491e (2dfd8370-00fa-4bf9-8120-926427c2491e): created successfully
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5140ca67-47f1-42ef-ba71-e0ea046fcfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (702f285e-55f7-437f-91cc-212546790254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b339fb78-52d3-4740-a9b4-e1d8f9c7cd58 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created volume successfully.
Jul 06 20:54:31 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733 1073741824" returned: 0 in 0.958s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:31 devstack sudo[96013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733
Jul 06 20:54:31 devstack sudo[96013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:32 devstack sudo[96013]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.698s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:54:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1235496203',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959aa3c2-e047-46b3-8407-8f19c3a967f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f94a5386053f4512b1ebedc765b0ea30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:54:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:54:26Z,use_quota=True,user_id='3c472adb4cac41b296a298b9d0f946a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Creating volume 959aa3c2-e047-46b3-8407-8f19c3a967f5 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:54:32 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:32 devstack sudo[96016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5 1073741824
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d73d471-711b-41b8-989a-7f7c8fe93804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:32 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e6dc2c-76b4-4ea3-b98b-c2d6d0974e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:32 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733 (72f4de6a-2fd2-4883-9aec-85cf7bab4733): created successfully
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e6dc2c-76b4-4ea3-b98b-c2d6d0974e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (50e06b81-f168-4059-9485-53e37bd286c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bf1a1226-f626-4392-a880-a27231aa919a tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created volume successfully.
Jul 06 20:54:33 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5 1073741824" returned: 0 in 0.975s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:33 devstack sudo[96022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5
Jul 06 20:54:33 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:34 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5" returned: 0 in 0.717s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.672s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f765a128-2675-4425-8bec-8697b0657c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959aa3c2-e047-46b3-8407-8f19c3a967f5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f3811f-738d-4e5d-8fbd-2fb9e9318cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Creating offline snapshot 1dfe1a41-a11f-4ac6-9ed3-ef99792999ef of volume 7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:54:34 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Volume volume-959aa3c2-e047-46b3-8407-8f19c3a967f5 (959aa3c2-e047-46b3-8407-8f19c3a967f5): created successfully
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f3811f-738d-4e5d-8fbd-2fb9e9318cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Flow 'volume_create_manager' (2fd417ba-318c-404d-8e20-e12eda38c68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56280c7-c69f-42f5-a2ac-5dbf67461ef0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:34 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-77c970a1-3bb3-4d83-b33f-f519732a0e14 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created volume successfully.
Jul 06 20:54:34 devstack sudo[96025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150
Jul 06 20:54:34 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-959aa3c2-e047-46b3-8407-8f19c3a967f5-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-959aa3c2-e047-46b3-8407-8f19c3a967f5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-quobyte-959aa3c2-e047-46b3-8407-8f19c3a967f5" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-959aa3c2-e047-46b3-8407-8f19c3a967f5" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dc5fba-148b-43b0-addb-700252767d90]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:34 devstack sudo[96027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5
Jul 06 20:54:34 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:35 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150" returned: 0 in 0.912s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:35 devstack sudo[96033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef 1G
Jul 06 20:54:35 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:35 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5" returned: 0 in 0.982s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:35 devstack sudo[96038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5
Jul 06 20:54:35 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:36 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef 1G" returned: 0 in 1.170s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c28abf8-eda7-4c46-9663-027edfff9150 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:36 devstack sudo[96044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c28abf8-eda7-4c46-9663-027edfff9150 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef
Jul 06 20:54:36 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:36 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-959aa3c2-e047-46b3-8407-8f19c3a967f5" returned: 0 in 0.845s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-959aa3c2-e047-46b3-8407-8f19c3a967f5" released by "delete_volume" :: held 1.878s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created reservations ['2f99080e-6f60-42e8-b355-ee22b80914b7', 'c692a150-c20f-422b-b943-76d7c160042b', '253b0500-599b-4af7-8774-6e291a9dfac6', 'bb207e35-44d1-4ed8-81c2-fb7df8f84285'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:36 devstack sudo[96046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:36 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-72f4de6a-2fd2-4883-9aec-85cf7bab4733-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-72f4de6a-2fd2-4883-9aec-85cf7bab4733-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-quobyte-72f4de6a-2fd2-4883-9aec-85cf7bab4733" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-72f4de6a-2fd2-4883-9aec-85cf7bab4733" acquired by "delete_volume" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf859b-2a48-44e3-bdf3-a826f76c423f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:37 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:37 devstack sudo[96052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7c28abf8-eda7-4c46-9663-027edfff9150 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" returned: 0 in 0.920s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:37 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef is being set with open permissions: ugo+rw
Jul 06 20:54:37 devstack sudo[96052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:37 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef
Jul 06 20:54:37 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:37 devstack sudo[96057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:37 devstack sudo[96057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:38 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.263s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Deleted volume successfully.
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e43ef1e7-de4a-4e38-993b-a869dfeb1e92 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-959aa3c2-e047-46b3-8407-8f19c3a967f5-delete_volume" released by "delete_volume" :: held 3.492s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:38 devstack sudo[96052]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733" returned: 0 in 1.240s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:38 devstack sudo[96065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733
Jul 06 20:54:38 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:38 devstack sudo[96057]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.111s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 8 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:54:38 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" returned: 0 in 1.302s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=140,cinder:DELETE=14,cinder:SELECT=118,cinder:INSERT=38 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:54:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:38 devstack sudo[96069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.info
Jul 06 20:54:38 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:39 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-72f4de6a-2fd2-4883-9aec-85cf7bab4733" returned: 0 in 0.919s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-72f4de6a-2fd2-4883-9aec-85cf7bab4733" released by "delete_volume" :: held 2.215s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created reservations ['43b238fd-47a6-4932-ab6f-99f0098e97dd', '0bf51668-b83a-4afc-8ef1-c68470a0ffa9', 'd4d92361-ab15-4cc4-ad17-af837c3bcb6e', 'd4355904-8e9f-4206-96c2-cbe394f88272'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:39 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.info" returned: 0 in 0.793s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:39 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.info is being set with open permissions: ugo+rw
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:39 devstack sudo[96073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.info
Jul 06 20:54:39 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:39 devstack sudo[96075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:39 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:40 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.info" returned: 0 in 0.923s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.212s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 13.656s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:40 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.895s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-2dfd8370-00fa-4bf9-8120-926427c2491e-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3163a038-507a-4657-9f76-09363738991e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Deleted volume successfully.
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-2dfd8370-00fa-4bf9-8120-926427c2491e-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-57de46cc-08cd-429d-8b7e-d984560144b5 tempest-SnapshotMetadataTestJSON-490974576 None] Create snapshot completed successfully
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4095eb7f-1b77-4679-ae21-96bb8b00e2e7 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-72f4de6a-2fd2-4883-9aec-85cf7bab4733-delete_volume" released by "delete_volume" :: held 3.586s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-quobyte-2dfd8370-00fa-4bf9-8120-926427c2491e" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-2dfd8370-00fa-4bf9-8120-926427c2491e" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0829d9-616d-417f-8b91-74f7c6ae925c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:40 devstack sudo[96079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:54:40 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:40 devstack sudo[96081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e
Jul 06 20:54:40 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:41 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 0.977s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[27744a70-d89f-47f9-abc7-b670e7b46593]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:41 devstack sudo[96092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:54:41 devstack sudo[96092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:41 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e" returned: 0 in 0.950s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:41 devstack sudo[96094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e
Jul 06 20:54:41 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "cinder-1dfe1a41-a11f-4ac6-9ed3-ef99792999ef-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-1dfe1a41-a11f-4ac6-9ed3-ef99792999ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "cinder-quobyte-7c28abf8-eda7-4c46-9663-027edfff9150" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-quobyte-7c28abf8-eda7-4c46-9663-027edfff9150" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "cinder-quobyte-1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-quobyte-1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Deleting offline snapshot 1dfe1a41-a11f-4ac6-9ed3-ef99792999ef of volume 7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] snapshot_file for this snap is: volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa29c286-a46f-4edc-9fd3-3e1efee38c7d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:42 devstack sudo[96096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef
Jul 06 20:54:42 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:42 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2dfd8370-00fa-4bf9-8120-926427c2491e" returned: 0 in 0.820s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-2dfd8370-00fa-4bf9-8120-926427c2491e" released by "delete_volume" :: held 1.824s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created reservations ['cb6caf67-d828-469e-b03a-a770fabab792', 'd0db85f3-1cb5-42d2-b0a1-b2ce08a6d838', 'a4290b86-9a4b-47c2-8247-2f3f4faf26a6', 'bb8b6291-aba7-4c42-b521-40b0b0524911'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:42 devstack sudo[96092]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 1.094s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.17ba6da0-1de8-41a8-8b10-a5efb1b2f79ff637ifn5.img {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:42 devstack sudo[96102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.17ba6da0-1de8-41a8-8b10-a5efb1b2f79ff637ifn5.img
Jul 06 20:54:42 devstack sudo[96102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:42 devstack sudo[96104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:42 devstack sudo[96104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-ee6843c7-cb1e-4939-954b-66feee54e5a8-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-ee6843c7-cb1e-4939-954b-66feee54e5a8-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-quobyte-ee6843c7-cb1e-4939-954b-66feee54e5a8" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-ee6843c7-cb1e-4939-954b-66feee54e5a8" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5872827-5322-4f34-865f-c32c2b1d9e80]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:43 devstack sudo[96106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8
Jul 06 20:54:43 devstack sudo[96106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:43 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" returned: 0 in 1.228s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7c28abf8-eda7-4c46-9663-027edfff9150(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[001c19bb-ec7a-4c43-aa6b-b2c92e202bdc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:43 devstack sudo[96104]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.129s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:43 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Deleted volume successfully.
Jul 06 20:54:43 devstack sudo[96122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150
Jul 06 20:54:43 devstack sudo[96122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac155a12-ecf9-475e-838b-3e8b0c3befa2 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-2dfd8370-00fa-4bf9-8120-926427c2491e-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:45 devstack sudo[96122]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150" returned: 0 in 1.406s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:45 devstack sudo[96131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef
Jul 06 20:54:45 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:45 devstack sudo[96106]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8" returned: 0 in 2.342s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:45 devstack sudo[96133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8
Jul 06 20:54:45 devstack sudo[96133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:47 devstack sudo[96133]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ee6843c7-cb1e-4939-954b-66feee54e5a8" returned: 0 in 1.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-ee6843c7-cb1e-4939-954b-66feee54e5a8" released by "delete_volume" :: held 4.154s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created reservations ['28040f27-1f87-4046-bc45-0690bd8d5d0a', 'e3ff70d7-fef6-437d-86c0-678da298b020', '81fb14ec-6fbe-4e13-99f4-cfc155b69287', 'ff1c89e0-6601-476d-934a-34411043c1b7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:47 devstack sudo[96141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:47 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-62be267c-c328-43f4-a833-56c27dbc8994-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-62be267c-c328-43f4-a833-56c27dbc8994-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-quobyte-62be267c-c328-43f4-a833-56c27dbc8994" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-62be267c-c328-43f4-a833-56c27dbc8994" acquired by "delete_volume" :: waited 0.078s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f32d913-847d-4973-99c6-bfb6fd7a7ca0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:48 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" returned: 0 in 3.503s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:48 devstack sudo[96144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef
Jul 06 20:54:48 devstack sudo[96144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:48 devstack sudo[96143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994
Jul 06 20:54:48 devstack sudo[96143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:49 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.314s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Deleted volume successfully.
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4ba13dce-40ea-473d-b26f-c11247735875 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-ee6843c7-cb1e-4939-954b-66feee54e5a8-delete_volume" released by "delete_volume" :: held 6.152s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.17ba6da0-1de8-41a8-8b10-a5efb1b2f79ff637ifn5.img" returned: 0 in 6.637s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94212086-9c8d-4099-a01e-9170cb8d502d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:49 devstack sudo[96151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:54:49 devstack sudo[96151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:49 devstack sudo[96144]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150.1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" returned: 0 in 1.227s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-quobyte-1dfe1a41-a11f-4ac6-9ed3-ef99792999ef" released by "_delete_snapshot" :: held 7.585s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-quobyte-7c28abf8-eda7-4c46-9663-027edfff9150" released by "delete_snapshot" :: held 7.608s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:49 devstack sudo[96143]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994" returned: 0 in 1.522s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:50 devstack sudo[96157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994
Jul 06 20:54:50 devstack sudo[96157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Created reservations ['0c733cab-93d7-42f9-9458-aa6dfd7ddfd9', '67576ed3-c0c4-4417-bdb5-248fe7b8e579', '95b628ef-b89c-4185-b33b-11be6309e5bb', '38ee92be-fa37-42ca-8455-06ede1073ee2'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:50 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Delete snapshot completed successfully.
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-016d760d-7e99-464a-a566-5032f5a95b12 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-1dfe1a41-a11f-4ac6-9ed3-ef99792999ef-delete_snapshot" released by "delete_snapshot" :: held 7.843s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:50 devstack sudo[96151]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 1.113s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.17ba6da0-1de8-41a8-8b10-a5efb1b2f79ff637ifn5.img {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:54:50 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Converted 1024.00 MB image at 154.24 MB/s
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] 17ba6da0-1de8-41a8-8b10-a5efb1b2f79f was raw, no need to convert to raw {{(pid=86721) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}}
Jul 06 20:54:50 devstack sudo[96157]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-62be267c-c328-43f4-a833-56c27dbc8994" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-62be267c-c328-43f4-a833-56c27dbc8994" released by "delete_volume" :: held 2.413s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created reservations ['33713f40-03ec-4a6c-b573-948293c22e87', '5e375805-87ce-4f73-8b97-70e9711a05a0', '6139d6ed-886e-4817-b77a-6532c79acc5b', 'bc04a51d-c7c1-4c53-91aa-9b962353ae7b'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:50 devstack sudo[96184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:50 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "cinder-7c28abf8-eda7-4c46-9663-027edfff9150-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-7c28abf8-eda7-4c46-9663-027edfff9150-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "cinder-quobyte-7c28abf8-eda7-4c46-9663-027edfff9150" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-quobyte-7c28abf8-eda7-4c46-9663-027edfff9150" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9288057e-3adb-408f-b725-f44192e7bf19]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:51 devstack sudo[96186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150
Jul 06 20:54:51 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-ded1db4c-22b0-4893-ade1-c2145bbe51fa-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-ded1db4c-22b0-4893-ade1-c2145bbe51fa-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "cinder-quobyte-ded1db4c-22b0-4893-ade1-c2145bbe51fa" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-ded1db4c-22b0-4893-ade1-c2145bbe51fa" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[28235b02-ad67-4508-b42e-80dfef21764c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:51 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.891s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Deleted volume successfully.
Jul 06 20:54:51 devstack sudo[96189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa
Jul 06 20:54:51 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6f9904ee-3a72-424b-8afb-ea4b31b6e36c tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-62be267c-c328-43f4-a833-56c27dbc8994-delete_volume" released by "delete_volume" :: held 3.698s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:52 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150" returned: 0 in 0.917s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:52 devstack sudo[96195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150
Jul 06 20:54:52 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:52 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa" returned: 0 in 0.898s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:52 devstack sudo[96201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa
Jul 06 20:54:52 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:53 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7c28abf8-eda7-4c46-9663-027edfff9150" returned: 0 in 0.965s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-quobyte-7c28abf8-eda7-4c46-9663-027edfff9150" released by "delete_volume" :: held 1.983s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Created reservations ['0eaed59c-9bbc-49cc-ae22-008f6c518f1a', 'c30d2905-0433-44ff-87f2-11c647dd6b5d', '5f94f80d-163c-4a04-86ec-1ef0d16287ba', 'db081206-0af8-4949-a501-bfec6313cfa6'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:53 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ded1db4c-22b0-4893-ade1-c2145bbe51fa" returned: 0 in 0.862s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:53 devstack sudo[96205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:53 devstack sudo[96205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-quobyte-ded1db4c-22b0-4893-ade1-c2145bbe51fa" released by "delete_volume" :: held 1.823s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Created reservations ['ce70aca5-7ba1-4621-8cc2-308cf35f44d2', '09eb5442-215a-47cc-b986-e8d8aa205f0f', 'f0fab755-ce3d-43e7-9491-a576de503de1', '2fea6c82-bc89-488c-8568-b75734173f23'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:54:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:54:53 devstack sudo[96207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:54:53 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:54:54 devstack sudo[96205]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.227s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:54 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Deleted volume successfully.
Jul 06 20:54:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1e6e2045-7246-4c82-be31-384cbaee8867 tempest-SnapshotMetadataTestJSON-490974576 None] Lock "cinder-7c28abf8-eda7-4c46-9663-027edfff9150-delete_volume" released by "delete_volume" :: held 3.701s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:54:54 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root
Jul 06 20:54:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.324s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:54:54 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:54:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Deleted volume successfully.
Jul 06 20:54:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92fe08cf-af78-4707-9492-de8abe403ff6 tempest-CreateVolumesFromSourceVolumeTest-1669145111 None] Lock "cinder-ded1db4c-22b0-4893-ade1-c2145bbe51fa-delete_volume" released by "delete_volume" :: held 3.459s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:08 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:55:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Flow 'volume_create_manager' (2f5d5f15-22b7-4128-829a-270904932fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67548caf-9591-49a1-8dee-a73304b28b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67548caf-9591-49a1-8dee-a73304b28b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-162026353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b6e3b9350b416087604c369ef0020a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:09Z,use_quota=True,user_id='373e767cc0b44c9cbfe042f0595ac241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31aecf7-3753-461c-8b6e-572f2ed556f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a31aecf7-3753-461c-8b6e-572f2ed556f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1560608-8d33-4407-a86a-50c3b5f64952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1560608-8d33-4407-a86a-50c3b5f64952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746', 'volume_name': 'volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8929d65-a419-40ee-8639-92b82b1a8e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8929d65-a419-40ee-8639-92b82b1a8e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0608fe-cbb5-4068-a5f1-5462ac8154ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:09 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Volume 6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746', 'volume_size': 1}
Jul 06 20:55:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:18 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=80,cinder:DELETE=7,cinder:INSERT=20,cinder:SELECT=47 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:55:19 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=40,cinder:INSERT=12,cinder:UPDATE=50,cinder:DELETE=2 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 40.177s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Uploaded volume to glance image-id: 17ba6da0-1de8-41a8-8b10-a5efb1b2f79f. {{(pid=86721) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.626s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-162026353',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b6e3b9350b416087604c369ef0020a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:09Z,use_quota=True,user_id='373e767cc0b44c9cbfe042f0595ac241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Creating volume 6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:55:20 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:55:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:20 devstack sudo[96710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 1073741824
Jul 06 20:55:20 devstack sudo[96710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4aea21f6-68a4-485d-ab8f-17560ccc5824 tempest-VolumesActionsTest-2000099908 None] Copy volume to image completed successfully.
Jul 06 20:55:21 devstack sudo[96710]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 1073741824" returned: 0 in 1.026s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:21 devstack sudo[96716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746
Jul 06 20:55:21 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:22 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746" returned: 0 in 0.794s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.167s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb0608fe-cbb5-4068-a5f1-5462ac8154ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25897d4e-04a1-4217-9208-24adfe91f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabd6820-bf84-4eeb-aa94-2c6fd42ca19e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:22 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Volume volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 (6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746): created successfully
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25897d4e-04a1-4217-9208-24adfe91f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Flow 'volume_create_manager' (2f5d5f15-22b7-4128-829a-270904932fd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:22 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c2c6d8e6-6468-44e9-80b2-aa044583e1f4 tempest-VolumesTransfersTest-1400258910 None] Created volume successfully.
Jul 06 20:55:22 devstack sudo[96719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:55:22 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:23 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 0.930s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14f9e5a-c056-4bc7-9d54-916b3c5ba77c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:23 devstack sudo[96724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:55:23 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:24 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9489ad7b-4b87-44a7-8932-25c8be4fed65 tempest-VolumesTransfersTest-169329290 None] Transfer volume completed successfully.
Jul 06 20:55:24 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 0.902s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:24 devstack sudo[96729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img
Jul 06 20:55:24 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Acquiring lock "cinder-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Lock "cinder-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Acquiring lock "cinder-quobyte-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Lock "cinder-quobyte-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:26 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49935d6-4301-4843-8293-fe68c0b9d2cd]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:26 devstack sudo[96741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746
Jul 06 20:55:26 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:28 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746" returned: 0 in 2.297s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:28 devstack sudo[96747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746
Jul 06 20:55:28 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:29 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746" returned: 0 in 1.300s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Lock "cinder-quobyte-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746" released by "delete_volume" :: held 3.747s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:29 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Created reservations ['4c8742e4-a8d2-4ae8-9ef0-ac9013de952b', 'd72faaec-1203-42d3-9883-daad7339e05d', 'fb4a6e57-8003-4d9c-b6f8-815fda0b186a', 'dddc9d6e-2c2b-4620-a594-047e13b746bd'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:55:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:30 devstack sudo[96753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:55:30 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:31 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img" returned: 0 in 6.471s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a824daa-0fd4-4818-8a9c-ec71df2e06ba]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:31 devstack sudo[96756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:55:31 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:31 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.166s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:55:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Deleted volume successfully.
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e4b5d071-9c07-42f9-ae53-b4430f41bb1a tempest-VolumesTransfersTest-770708791 None] Lock "cinder-6f5a55c9-ca7f-46ad-aca9-4c63ab7e8746-delete_volume" released by "delete_volume" :: held 5.480s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Flow 'volume_create_manager' (caf8d2b4-15aa-4d95-a688-3a1d4fcb38db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9229b6-d0cb-4b9c-9d25-eec03799f146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e9229b6-d0cb-4b9c-9d25-eec03799f146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1688834091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2ab911-a1fe-4529-8cc7-dc84aa92a187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134422d7b76942a28a0b0d9c71bd916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:31Z,use_quota=True,user_id='2ac875936e794b5486384bf72035a464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137f7a80-f56d-480e-8f74-b84caf2897cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (137f7a80-f56d-480e-8f74-b84caf2897cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636e72f0-8954-4df1-a5aa-1fabd0c9844f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (636e72f0-8954-4df1-a5aa-1fabd0c9844f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea2ab911-a1fe-4529-8cc7-dc84aa92a187', 'volume_name': 'volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f1758f-6bd7-4c6a-9561-3e388c411783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7f1758f-6bd7-4c6a-9561-3e388c411783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb8ed10-d46a-4ce4-a494-45a121c4e952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Volume ea2ab911-a1fe-4529-8cc7-dc84aa92a187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187', 'volume_size': 1}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Flow 'volume_create_manager' (c760d16a-8950-4b97-852f-50eacdafd263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cd23d7-c6bd-4a2f-a518-92055538cc54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98cd23d7-c6bd-4a2f-a518-92055538cc54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1692450125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3b764b-da62-435f-8b88-57d3f5725a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b6e3b9350b416087604c369ef0020a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:32Z,use_quota=True,user_id='373e767cc0b44c9cbfe042f0595ac241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd6738b-10bd-4d3a-bada-9666f986ed5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd6738b-10bd-4d3a-bada-9666f986ed5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fcf6c5-58dd-46a5-a196-a9029dc4535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22fcf6c5-58dd-46a5-a196-a9029dc4535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3b764b-da62-435f-8b88-57d3f5725a64', 'volume_name': 'volume-3b3b764b-da62-435f-8b88-57d3f5725a64', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a6c9fb-0f3d-4ad1-bd28-35da2da8359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a6c9fb-0f3d-4ad1-bd28-35da2da8359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6111e5ff-14b8-4e00-b338-ac5c975216a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:31 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Volume 3b3b764b-da62-435f-8b88-57d3f5725a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3b764b-da62-435f-8b88-57d3f5725a64', 'volume_size': 1}
Jul 06 20:55:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:32 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 1.117s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:32 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373, size 1024.00 MB, duration 6.48 sec, destination /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:55:32 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Converted 1024.00 MB image at 158.14 MB/s
Jul 06 20:55:32 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] bda9b9fc-eae1-4a77-a340-8e5227d80266 was raw, converting to qcow2 {{(pid=86721) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}}
Jul 06 20:55:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21f8f09-6a01-4c72-bb76-1804f1e4ba0d]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:32 devstack sudo[96763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img
Jul 06 20:55:32 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:33 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img" returned: 0 in 0.826s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:33 devstack sudo[96767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img
Jul 06 20:55:33 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:33 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img" returned: 1 in 0.730s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:55:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img /opt/stack/data/cinder/conversion/vol_upload_nb14itun {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:33 devstack sudo[96772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img /opt/stack/data/cinder/conversion/vol_upload_nb14itun
Jul 06 20:55:33 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:34 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img /opt/stack/data/cinder/conversion/vol_upload_nb14itun" returned: 0 in 0.712s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:34 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Image conversion details: src /opt/stack/data/cinder/conversion/1674415f-6318-4756-a9f0-c6453ecfc373.temp_image.bda9b9fc-eae1-4a77-a340-8e5227d80266wfxc2a3x.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_nb14itun {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:55:34 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Converted 1024.00 MB image at 1024.00 MB/s
Jul 06 20:55:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[537f550c-b396-4cc8-8a23-e08cf0e2efb2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nb14itun {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:34 devstack sudo[96778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nb14itun
Jul 06 20:55:34 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:35 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_nb14itun" returned: 0 in 0.767s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.127s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Uploaded volume to glance image-id: bda9b9fc-eae1-4a77-a340-8e5227d80266. {{(pid=86721) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.197s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1688834091',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea2ab911-a1fe-4529-8cc7-dc84aa92a187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134422d7b76942a28a0b0d9c71bd916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:31Z,use_quota=True,user_id='2ac875936e794b5486384bf72035a464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Creating volume ea2ab911-a1fe-4529-8cc7-dc84aa92a187 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:55:36 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:55:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:36 devstack sudo[96783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 1073741824
Jul 06 20:55:36 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:36 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3a7acb5f-a8df-4d33-aed2-66d81da6251a tempest-VolumesActionsTest-2000099908 None] Copy volume to image completed successfully.
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:37 devstack sudo[96790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:55:37 devstack sudo[96790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:37 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 1073741824" returned: 0 in 1.030s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:37 devstack sudo[96792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187
Jul 06 20:55:37 devstack sudo[96792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "cinder-quobyte-1674415f-6318-4756-a9f0-c6453ecfc373" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-quobyte-1674415f-6318-4756-a9f0-c6453ecfc373" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c78f3a4-81db-42ee-baa3-04ad4cc11d65]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:38 devstack sudo[96794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:55:38 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:38 devstack sudo[96790]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.988s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:55:38 devstack sudo[96792]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187" returned: 0 in 0.952s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.054s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.033s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1692450125',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3b764b-da62-435f-8b88-57d3f5725a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62b6e3b9350b416087604c369ef0020a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:32Z,use_quota=True,user_id='373e767cc0b44c9cbfe042f0595ac241',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Creating volume 3b3b764b-da62-435f-8b88-57d3f5725a64 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:55:38 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb8ed10-d46a-4ce4-a494-45a121c4e952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:38 devstack sudo[96799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64 1073741824
Jul 06 20:55:38 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f6d18d-4663-4c04-962b-e8804032ed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Volume volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 (ea2ab911-a1fe-4529-8cc7-dc84aa92a187): created successfully
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32f6d18d-4663-4c04-962b-e8804032ed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Flow 'volume_create_manager' (caf8d2b4-15aa-4d95-a688-3a1d4fcb38db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:39 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ce5a0966-05f9-4bd2-a6c0-37f6c2b54394 tempest-AttachVolumeNegativeTest-75244407 None] Created volume successfully.
Jul 06 20:55:39 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 0.998s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:39 devstack sudo[96804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373
Jul 06 20:55:39 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Flow 'volume_create_manager' (ddcbb437-3120-4a68-952f-0bb3c7d19718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f944b57-4f15-48f7-9435-2ed2712078f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f944b57-4f15-48f7-9435-2ed2712078f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1651547511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e207bc1-27fe-492f-a164-62ad1ee83522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f08560346d45958db4729ecf528f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:40Z,use_quota=True,user_id='7a69173ea8a245ceb1cdd96b86c114a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d76ff5-fe98-4b45-993f-c6e3bde875ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07d76ff5-fe98-4b45-993f-c6e3bde875ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a523cab0-4c09-4478-b4d8-014d0288ca28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a523cab0-4c09-4478-b4d8-014d0288ca28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e207bc1-27fe-492f-a164-62ad1ee83522', 'volume_name': 'volume-7e207bc1-27fe-492f-a164-62ad1ee83522', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18de3ba-65f8-4fab-b9f8-936df6ab6eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d18de3ba-65f8-4fab-b9f8-936df6ab6eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb41692e-6e18-4c84-8ee2-d8d26c42bd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:39 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Volume 7e207bc1-27fe-492f-a164-62ad1ee83522: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e207bc1-27fe-492f-a164-62ad1ee83522', 'volume_size': 1}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:39 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64 1073741824" returned: 0 in 0.920s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:39 devstack sudo[96810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64
Jul 06 20:55:39 devstack sudo[96810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:40 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1674415f-6318-4756-a9f0-c6453ecfc373" returned: 0 in 0.743s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-quobyte-1674415f-6318-4756-a9f0-c6453ecfc373" released by "delete_volume" :: held 1.815s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Created reservations ['c7e945e9-2e91-40ec-8a0b-d24cbc90a7d4', '905871a5-c985-4da4-9062-8d8ed10328cd', '86efa76a-173d-4717-80e2-e9145ed03977', 'd28ae468-889a-416f-ada0-909de677ef1e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:40 devstack sudo[96817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:55:40 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:40 devstack sudo[96810]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64" returned: 0 in 0.731s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.967s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1651547511',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e207bc1-27fe-492f-a164-62ad1ee83522,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f08560346d45958db4729ecf528f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:40Z,use_quota=True,user_id='7a69173ea8a245ceb1cdd96b86c114a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Creating volume 7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:55:40 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:40 devstack sudo[96849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 1073741824
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6111e5ff-14b8-4e00-b338-ac5c975216a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3b764b-da62-435f-8b88-57d3f5725a64', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:40 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754b4803-eb04-4672-895e-9067845fea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:40 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Volume volume-3b3b764b-da62-435f-8b88-57d3f5725a64 (3b3b764b-da62-435f-8b88-57d3f5725a64): created successfully
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (754b4803-eb04-4672-895e-9067845fea39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Flow 'volume_create_manager' (c760d16a-8950-4b97-852f-50eacdafd263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9f0051e2-35e8-4a9f-90a8-eb750dd1271d tempest-VolumesTransfersTest-1400258910 None] Created volume successfully.
Jul 06 20:55:41 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.786s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:55:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Deleted volume successfully.
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f7a13f1e-861f-4e49-b5c4-357afc786493 tempest-VolumesActionsTest-2000099908 None] Lock "cinder-1674415f-6318-4756-a9f0-c6453ecfc373-delete_volume" released by "delete_volume" :: held 2.861s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:41 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 1073741824" returned: 0 in 1.025s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:41 devstack sudo[96915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522
Jul 06 20:55:41 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Acquiring lock "cinder-3b3b764b-da62-435f-8b88-57d3f5725a64-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Lock "cinder-3b3b764b-da62-435f-8b88-57d3f5725a64-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Acquiring lock "cinder-quobyte-3b3b764b-da62-435f-8b88-57d3f5725a64" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Lock "cinder-quobyte-3b3b764b-da62-435f-8b88-57d3f5725a64" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bc46dc-8f5d-4427-95ab-8982e431236c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:42 devstack sudo[96917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64
Jul 06 20:55:42 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:42 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522" returned: 0 in 0.825s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb41692e-6e18-4c84-8ee2-d8d26c42bd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e207bc1-27fe-492f-a164-62ad1ee83522', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48950e42-2129-4939-8cb8-435eda7b645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:42 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Volume volume-7e207bc1-27fe-492f-a164-62ad1ee83522 (7e207bc1-27fe-492f-a164-62ad1ee83522): created successfully
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48950e42-2129-4939-8cb8-435eda7b645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Flow 'volume_create_manager' (ddcbb437-3120-4a68-952f-0bb3c7d19718) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:42 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-288a9425-9ea1-4d6c-b1f1-5f1424ca03bc tempest-SnapshotDependencyTests-664467025 None] Created volume successfully.
Jul 06 20:55:42 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64" returned: 0 in 0.976s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:42 devstack sudo[96925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64
Jul 06 20:55:42 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Creating offline snapshot b9e029da-5964-49b9-be00-659e7932b3f6 of volume 7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[540d4ddd-6027-4767-bb9e-b7fed248def3]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:43 devstack sudo[96935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522
Jul 06 20:55:43 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-57bcc66c-e8e7-4f38-b0d1-05a22fcd7555 req-13ae6865-65dc-4a5c-99b8-d175bc1f6422 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:43 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3b3b764b-da62-435f-8b88-57d3f5725a64" returned: 0 in 0.931s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Lock "cinder-quobyte-3b3b764b-da62-435f-8b88-57d3f5725a64" released by "delete_volume" :: held 1.953s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:43 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Created reservations ['fdcac051-4598-48d0-aaf0-0864fdb647d7', '42f663cb-6463-4642-ae2e-54691d962d2c', 'dce3ca68-2faf-47dc-9dca-07b626cc09e3', 'a480bdb7-c8a0-448a-8284-11efc1d10724'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:44 devstack sudo[96943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:55:44 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:44 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522" returned: 0 in 1.040s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:44 devstack sudo[96945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 1G
Jul 06 20:55:44 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:45 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.996s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:45 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:55:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Deleted volume successfully.
Jul 06 20:55:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ea021597-4d38-45e4-9a10-5dc13b3b9b14 tempest-VolumesTransfersTest-770708791 None] Lock "cinder-3b3b764b-da62-435f-8b88-57d3f5725a64-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:45 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 1G" returned: 0 in 1.250s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e207bc1-27fe-492f-a164-62ad1ee83522 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:45 devstack sudo[96953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e207bc1-27fe-492f-a164-62ad1ee83522 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6
Jul 06 20:55:45 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:46 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e207bc1-27fe-492f-a164-62ad1ee83522 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6" returned: 0 in 0.799s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:46 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 is being set with open permissions: ugo+rw
Jul 06 20:55:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:46 devstack sudo[96958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6
Jul 06 20:55:46 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:46 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6" returned: 0 in 0.735s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:47 devstack sudo[96961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.info
Jul 06 20:55:47 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:47 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.info" returned: 0 in 0.821s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:47 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.info is being set with open permissions: ugo+rw
Jul 06 20:55:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:47 devstack sudo[96965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.info
Jul 06 20:55:47 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:48 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.info" returned: 0 in 0.776s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.524s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-57bcc66c-e8e7-4f38-b0d1-05a22fcd7555 req-13ae6865-65dc-4a5c-99b8-d175bc1f6422 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.254s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9df9fe6-37b5-4818-b9fb-5d7858490805]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-57bcc66c-e8e7-4f38-b0d1-05a22fcd7555 req-13ae6865-65dc-4a5c-99b8-d175bc1f6422 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Flow 'volume_create_manager' (0dd122e8-366b-4564-823c-7acac4ac9c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c041d65-35ac-46c1-ac69-8041c1e9d6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-dbec7468-ed37-4950-a66f-035478e5dff2 tempest-SnapshotDependencyTests-664467025 None] Create snapshot completed successfully
Jul 06 20:55:48 devstack sudo[96968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187
Jul 06 20:55:48 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c041d65-35ac-46c1-ac69-8041c1e9d6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1792827498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f8abf9-d92f-4360-8579-efe2a41b59cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b193db499746318a18651ff4d5c0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:49Z,use_quota=True,user_id='fd9bb563a42343fdb845181ce572e44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ed7f64-9ef2-45a3-8c1e-8badbaa23702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ed7f64-9ef2-45a3-8c1e-8badbaa23702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72333752-c231-4d82-aedf-d09a64a8c729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:48 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72333752-c231-4d82-aedf-d09a64a8c729) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42f8abf9-d92f-4360-8579-efe2a41b59cd', 'volume_name': 'volume-42f8abf9-d92f-4360-8579-efe2a41b59cd', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec4d0260>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be4182-3a27-40c4-959b-3fa99d6b5e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be4182-3a27-40c4-959b-3fa99d6b5e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17159cd7-92f1-4d89-950e-3396b0acd48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:49 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Volume 42f8abf9-d92f-4360-8579-efe2a41b59cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42f8abf9-d92f-4360-8579-efe2a41b59cd', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec4d0260>}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Trying to clone 42f8abf9-d92f-4360-8579-efe2a41b59cd from image 0acbb0cd-0336-492a-b73d-b152eae4e946 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 20:55:49 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-57bcc66c-e8e7-4f38-b0d1-05a22fcd7555 req-13ae6865-65dc-4a5c-99b8-d175bc1f6422 tempest-AttachVolumeNegativeTest-75244407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187" returned: 0 in 0.996s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-57bcc66c-e8e7-4f38-b0d1-05a22fcd7555 req-13ae6865-65dc-4a5c-99b8-d175bc1f6422 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.025s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 20:55:49 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-57bcc66c-e8e7-4f38-b0d1-05a22fcd7555 req-13ae6865-65dc-4a5c-99b8-d175bc1f6422 tempest-AttachVolumeNegativeTest-75244407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cc3b73d-a1a5-4a38-a5e0-aa265e461e85', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ce01f1-9ca4-402f-be02-8f295ae245de]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-57bcc66c-e8e7-4f38-b0d1-05a22fcd7555 req-13ae6865-65dc-4a5c-99b8-d175bc1f6422 tempest-AttachVolumeNegativeTest-75244407 None] attachment_update completed successfully.
Jul 06 20:55:49 devstack sudo[96974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD
Jul 06 20:55:49 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Flow 'volume_create_manager' (d20c05f1-846c-4be6-adea-c9f2a18f838c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037041d9-a9c5-4ee5-aebf-b21470e0e92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037041d9-a9c5-4ee5-aebf-b21470e0e92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55abd9a7-fe36-41f5-8b4a-426d2205d9f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86f08560346d45958db4729ecf528f64',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b9e029da-5964-49b9-be00-659e7932b3f6,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:50Z,use_quota=True,user_id='7a69173ea8a245ceb1cdd96b86c114a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9727fdb-c0d9-45f2-8d11-0cabd721de84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9727fdb-c0d9-45f2-8d11-0cabd721de84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e7481f-5072-4450-b62f-f911dedbb266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e7481f-5072-4450-b62f-f911dedbb266) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55abd9a7-fe36-41f5-8b4a-426d2205d9f4', 'volume_name': 'volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4', 'volume_size': 1, 'snapshot_id': 'b9e029da-5964-49b9-be00-659e7932b3f6'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b66dda-2326-415c-9bd6-5790716b1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b66dda-2326-415c-9bd6-5790716b1274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6288fdbe-de8e-49ab-8779-8e1d9ca5e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Volume 55abd9a7-fe36-41f5-8b4a-426d2205d9f4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4', 'volume_size': 1, 'snapshot_id': 'b9e029da-5964-49b9-be00-659e7932b3f6'}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-quobyte-b9e029da-5964-49b9-be00-659e7932b3f6-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-b9e029da-5964-49b9-be00-659e7932b3f6-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Creating volume 55abd9a7-fe36-41f5-8b4a-426d2205d9f4 from snapshot b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-quobyte-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] snapshot: b9e029da-5964-49b9-be00-659e7932b3f6, volume: 55abd9a7-fe36-41f5-8b4a-426d2205d9f4,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6669d47f-37eb-4d59-819d-087f8444d834]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:50 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD" returned: 0 in 0.904s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 is fetched for user fd9bb563a42343fdb845181ce572e44c. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fca7071-2119-46f4-8533-faf26f5f9028]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:50 devstack sudo[97047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6
Jul 06 20:55:50 devstack sudo[97047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:50 devstack sudo[97362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD
Jul 06 20:55:50 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:51 devstack sudo[97047]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6" returned: 0 in 0.887s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e207bc1-27fe-492f-a164-62ad1ee83522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a272de-eb91-42b5-aa84-a30bcc894c49]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:51 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD" returned: 0 in 0.850s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:51 devstack sudo[97372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522
Jul 06 20:55:51 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:52 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522" returned: 0 in 0.824s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:52 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:55:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:52 devstack sudo[97378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4
Jul 06 20:55:52 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:52 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:55:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Flow 'volume_create_manager' (4c208ef7-14a2-42e5-9503-23867b85c808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52623172-9797-41b5-97a1-8edf548f3822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52623172-9797-41b5-97a1-8edf548f3822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-306890934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e97b73c-8b53-4034-916b-30c4c5e83e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10273722eeac4bd694c931f0d13259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:53Z,use_quota=True,user_id='11f2cfb38c6043849135da0e678d2a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d9139d-c77d-4c1f-a416-763d82e04e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d9139d-c77d-4c1f-a416-763d82e04e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9114b35-8db3-4c7e-bbf4-e788c20e6e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9114b35-8db3-4c7e-bbf4-e788c20e6e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e97b73c-8b53-4034-916b-30c4c5e83e0b', 'volume_name': 'volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588d2782-1c9d-49a3-a6c5-4a8224e3bb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588d2782-1c9d-49a3-a6c5-4a8224e3bb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d163cb-e72a-44a6-9e9f-c2de87315476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Volume 9e97b73c-8b53-4034-916b-30c4c5e83e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b', 'volume_size': 1}
Jul 06 20:55:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:57 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" returned: 0 in 5.498s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a895d79-4c12-4e56-a3b3-b0c7ccc18fe2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:55:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:57 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522
Jul 06 20:55:57 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:58 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522" returned: 0 in 0.983s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:58 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:55:58 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Converted 1024.00 MB image at 186.21 MB/s
Jul 06 20:55:58 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 is being set with open permissions: ugo+rw
Jul 06 20:55:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:58 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4
Jul 06 20:55:58 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:59 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" returned: 0 in 0.720s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" released by "_copy_volume_from_snapshot" :: held 9.041s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-b9e029da-5964-49b9-be00-659e7932b3f6-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" released by "_create_volume_from_snapshot" :: held 9.080s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.099s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1792827498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42f8abf9-d92f-4360-8579-efe2a41b59cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b193db499746318a18651ff4d5c0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:49Z,use_quota=True,user_id='fd9bb563a42343fdb845181ce572e44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Creating volume 42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:55:59 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:55:59 devstack sudo[97404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 1073741824
Jul 06 20:55:59 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6288fdbe-de8e-49ab-8779-8e1d9ca5e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4', 'volume_size': 1, 'snapshot_id': 'b9e029da-5964-49b9-be00-659e7932b3f6'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bddf3a-0804-418f-b3fa-5c8220962f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:55:59 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Volume volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 (55abd9a7-fe36-41f5-8b4a-426d2205d9f4): created successfully
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78bddf3a-0804-418f-b3fa-5c8220962f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:55:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Flow 'volume_create_manager' (d20c05f1-846c-4be6-adea-c9f2a18f838c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:55:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e62dda30-3444-4304-9b74-152ab56b199d tempest-SnapshotDependencyTests-664467025 None] Created volume successfully.
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-b9e029da-5964-49b9-be00-659e7932b3f6-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-b9e029da-5964-49b9-be00-659e7932b3f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-quobyte-7e207bc1-27fe-492f-a164-62ad1ee83522" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-7e207bc1-27fe-492f-a164-62ad1ee83522" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-quobyte-b9e029da-5964-49b9-be00-659e7932b3f6" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-b9e029da-5964-49b9-be00-659e7932b3f6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Deleting offline snapshot b9e029da-5964-49b9-be00-659e7932b3f6 of volume 7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] snapshot_file for this snap is: volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb06c2e0-e643-4423-a7db-ef02f2367669]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:00 devstack sudo[97410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6
Jul 06 20:56:00 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:00 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 1073741824" returned: 0 in 0.945s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:00 devstack sudo[97413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:00 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:01 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6" returned: 0 in 0.778s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e207bc1-27fe-492f-a164-62ad1ee83522(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51998c1-91a7-4cdc-ae5b-542bf2dfbf99]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:01 devstack sudo[97418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522
Jul 06 20:56:01 devstack sudo[97418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:01 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 0 in 0.694s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.250s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-306890934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e97b73c-8b53-4034-916b-30c4c5e83e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10273722eeac4bd694c931f0d13259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:55:53Z,use_quota=True,user_id='11f2cfb38c6043849135da0e678d2a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Creating volume 9e97b73c-8b53-4034-916b-30c4c5e83e0b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:56:01 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:01 devstack sudo[97421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b 1073741824
Jul 06 20:56:01 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Attempting download of 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume 42f8abf9-d92f-4360-8579-efe2a41b59cd. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[408f19c5-e58d-4ad8-8c85-7655fc0dda8a]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_vjho5g4p {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:01 devstack sudo[97423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_vjho5g4p
Jul 06 20:56:01 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:02 devstack sudo[97418]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522" returned: 0 in 0.895s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:02 devstack sudo[97431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6
Jul 06 20:56:02 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:02 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b 1073741824" returned: 0 in 0.979s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:02 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_vjho5g4p" returned: 0 in 0.864s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_vjho5g4p {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:02 devstack sudo[97437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b
Jul 06 20:56:02 devstack sudo[97437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:02 devstack sudo[97436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_vjho5g4p
Jul 06 20:56:02 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:02 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6" returned: 0 in 0.879s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:02 devstack sudo[97443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6
Jul 06 20:56:02 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:03 devstack sudo[97437]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b" returned: 0 in 0.711s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.755s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91d163cb-e72a-44a6-9e9f-c2de87315476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab2b6ca-cc80-4b69-88f7-13e03181b0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:03 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Volume volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b (9e97b73c-8b53-4034-916b-30c4c5e83e0b): created successfully
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ab2b6ca-cc80-4b69-88f7-13e03181b0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Flow 'volume_create_manager' (4c208ef7-14a2-42e5-9503-23867b85c808) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a1589f25-6861-406a-837d-c5f7c8830df4 tempest-VolumesTransfersV357Test-253659674 None] Created volume successfully.
Jul 06 20:56:03 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_vjho5g4p" returned: 1 in 0.850s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_vjho5g4p' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d01180-869a-42a9-991d-8a14ca23455b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:03 devstack sudo[97448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD
Jul 06 20:56:03 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:03 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522.b9e029da-5964-49b9-be00-659e7932b3f6" returned: 0 in 0.716s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-b9e029da-5964-49b9-be00-659e7932b3f6" released by "_delete_snapshot" :: held 3.413s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-7e207bc1-27fe-492f-a164-62ad1ee83522" released by "delete_snapshot" :: held 3.449s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Created reservations ['27226f4a-bfad-44f7-baa8-f7c0f916b121', 'de1223c7-5641-4a9f-a2e4-61e2baedc128', 'd7432813-60df-4497-a345-5dd1663f9d11', 'bbda2431-c08b-4620-9a31-053e78d0a208'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Delete snapshot completed successfully.
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-92f0868c-cfe7-4584-a331-924cfcfed801 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-b9e029da-5964-49b9-be00-659e7932b3f6-delete_snapshot" released by "delete_snapshot" :: held 3.683s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:03 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] 0acbb0cd-0336-492a-b73d-b152eae4e946 was qcow2, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 20:56:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:04 devstack sudo[97455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:04 devstack sudo[97455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-7e207bc1-27fe-492f-a164-62ad1ee83522-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-7e207bc1-27fe-492f-a164-62ad1ee83522-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-quobyte-7e207bc1-27fe-492f-a164-62ad1ee83522" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-7e207bc1-27fe-492f-a164-62ad1ee83522" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ee1e84-a9ab-4eb1-b4dd-317b8715a4c1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:04 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6d6e67f9-3fa8-4500-863b-021dcf1d2123 tempest-VolumesTransfersV357Test-1193504286 None] Transfer volume completed successfully.
Jul 06 20:56:04 devstack sudo[97461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522
Jul 06 20:56:04 devstack sudo[97461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:05 devstack sudo[97461]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522" returned: 0 in 1.208s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:06 devstack sudo[97505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522
Jul 06 20:56:06 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Acquiring lock "cinder-9e97b73c-8b53-4034-916b-30c4c5e83e0b-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-9e97b73c-8b53-4034-916b-30c4c5e83e0b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Acquiring lock "cinder-quobyte-9e97b73c-8b53-4034-916b-30c4c5e83e0b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-quobyte-9e97b73c-8b53-4034-916b-30c4c5e83e0b" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[47598c7f-cc3f-4d95-92c2-f50d86c11da3]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:06 devstack sudo[97513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b
Jul 06 20:56:06 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:06 devstack sudo[97455]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 0 in 2.924s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_awpo0cd3devstack@QuobyteHD, size 112.00 MB, duration 2.93 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:56:06 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Converted 112.00 MB image at 38.27 MB/s
Jul 06 20:56:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:06 devstack sudo[97525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 1G
Jul 06 20:56:06 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:07 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7e207bc1-27fe-492f-a164-62ad1ee83522" returned: 0 in 1.159s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-7e207bc1-27fe-492f-a164-62ad1ee83522" released by "delete_volume" :: held 2.438s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Created reservations ['a177a9c4-f0a6-4661-84c6-75f8b741a466', '53efd053-e8c4-49fe-999b-fab9346306e7', '724a4d0a-e185-4914-9781-e3bce0eeab3d', 'a08cd7c4-118f-429e-882e-67278db1f3bb'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:07 devstack sudo[97528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:07 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:07 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b" returned: 0 in 1.150s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:07 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b
Jul 06 20:56:07 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:07 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 1G" returned: 0 in 0.824s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fa6608-e6ea-4e85-b78c-028f6c0d2e64]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:07 devstack sudo[97539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:07 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-55abd9a7-fe36-41f5-8b4a-426d2205d9f4-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-55abd9a7-fe36-41f5-8b4a-426d2205d9f4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:08 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.845s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Deleted volume successfully.
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "cinder-quobyte-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-feb101d8-84f8-4c23-b96a-e272aa8cab18 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-7e207bc1-27fe-492f-a164-62ad1ee83522-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee51e13-8a1c-4e59-aad7-1226586068da]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:08 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e97b73c-8b53-4034-916b-30c4c5e83e0b" returned: 0 in 0.834s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-quobyte-9e97b73c-8b53-4034-916b-30c4c5e83e0b" released by "delete_volume" :: held 2.050s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Created reservations ['25940a32-0ab6-43a0-a387-fefffc1c44d9', 'd6b4a32f-fc32-4556-8617-1e56d36b5823', 'd87143c4-f761-4398-8097-4d7fef14dfaa', '5826b487-9119-4512-95aa-29fdf113613c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:08 devstack sudo[97543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4
Jul 06 20:56:08 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:08 devstack sudo[97545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:08 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:08 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 0 in 0.996s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:08 devstack sudo[97549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:08 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:09 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" returned: 0 in 0.938s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:09 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:09 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4
Jul 06 20:56:09 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.755s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Deleted volume successfully.
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0b4e74b2-0f49-46c3-b12e-9bc7c28a5de6 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-9e97b73c-8b53-4034-916b-30c4c5e83e0b-delete_volume" released by "delete_volume" :: held 3.126s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:09 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 1 in 1.050s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Downloaded image 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume 42f8abf9-d92f-4360-8579-efe2a41b59cd successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 for user fd9bb563a42343fdb845181ce572e44c is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Marking volume 42f8abf9-d92f-4360-8579-efe2a41b59cd as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Copying metadata from image 0acbb0cd-0336-492a-b73d-b152eae4e946 to 42f8abf9-d92f-4360-8579-efe2a41b59cd. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Creating volume glance metadata for volume 42f8abf9-d92f-4360-8579-efe2a41b59cd backed by image 0acbb0cd-0336-492a-b73d-b152eae4e946 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 20:56:09 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" returned: 0 in 0.761s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-quobyte-55abd9a7-fe36-41f5-8b4a-426d2205d9f4" released by "delete_volume" :: held 1.757s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17159cd7-92f1-4d89-950e-3396b0acd48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42f8abf9-d92f-4360-8579-efe2a41b59cd', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec4d0260>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8880c7-5022-428a-b3c8-1e45f11c74b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:10 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Volume volume-42f8abf9-d92f-4360-8579-efe2a41b59cd (42f8abf9-d92f-4360-8579-efe2a41b59cd): created successfully
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa8880c7-5022-428a-b3c8-1e45f11c74b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Flow 'volume_create_manager' (0dd122e8-366b-4564-823c-7acac4ac9c4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Created reservations ['86d0db93-4844-4dfb-a6f2-8eb71b35c730', '8e38e339-1c62-4d7c-967f-c97414e73617', 'c7cbe23f-bed3-4344-a350-379539d4a2fe', 'e7a3a956-b736-46aa-bca2-391db36da1ef'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3ca7088d-50b5-402c-a407-9544aea8435d tempest-VolumesExtendTest-1595222929 None] Created volume successfully.
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Flow 'volume_create_manager' (b2dfbb85-2c1d-49ce-b34d-bef9e63e70a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e5668f-91ea-488a-a84a-728d92927f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e5668f-91ea-488a-a84a-728d92927f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-714609829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc2da55-e022-4737-a897-e8f5dae76a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10273722eeac4bd694c931f0d13259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:10Z,use_quota=True,user_id='11f2cfb38c6043849135da0e678d2a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6351433f-2cb4-4e0a-bd91-374a11c636dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6351433f-2cb4-4e0a-bd91-374a11c636dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b29d808-8756-4a42-bae9-e7042317fa89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b29d808-8756-4a42-bae9-e7042317fa89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc2da55-e022-4737-a897-e8f5dae76a02', 'volume_name': 'volume-ebc2da55-e022-4737-a897-e8f5dae76a02', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd3f0f6-4963-4fdc-a674-a4980ec02e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd3f0f6-4963-4fdc-a674-a4980ec02e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6111339-ca02-456b-bfc2-3dfd1c34e3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:10 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Volume ebc2da55-e022-4737-a897-e8f5dae76a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc2da55-e022-4737-a897-e8f5dae76a02', 'volume_size': 1}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-714609829',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebc2da55-e022-4737-a897-e8f5dae76a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10273722eeac4bd694c931f0d13259df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:10Z,use_quota=True,user_id='11f2cfb38c6043849135da0e678d2a11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Creating volume ebc2da55-e022-4737-a897-e8f5dae76a02 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:56:10 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:10 devstack sudo[97596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02 1073741824
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:10 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:10 devstack sudo[97598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:10 devstack sudo[97598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:11 devstack sudo[97598]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.061s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:11 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Deleted volume successfully.
Jul 06 20:56:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1cc2a172-c6cd-4d72-a587-89a9ad654e83 tempest-SnapshotDependencyTests-664467025 None] Lock "cinder-55abd9a7-fe36-41f5-8b4a-426d2205d9f4-delete_volume" released by "delete_volume" :: held 3.413s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:11 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02 1073741824" returned: 0 in 1.511s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:11 devstack sudo[97623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02
Jul 06 20:56:11 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:12 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02" returned: 0 in 0.894s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] <== create_volume: return (2497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.514s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.813s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6111339-ca02-456b-bfc2-3dfd1c34e3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc2da55-e022-4737-a897-e8f5dae76a02', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b2f7ba-f168-4144-9638-2abfbc5010c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e976f01e-a8ee-40e3-82c7-4947196393f5]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Volume volume-ebc2da55-e022-4737-a897-e8f5dae76a02 (ebc2da55-e022-4737-a897-e8f5dae76a02): created successfully
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b2f7ba-f168-4144-9638-2abfbc5010c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Flow 'volume_create_manager' (b2dfbb85-2c1d-49ce-b34d-bef9e63e70a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9e4a0111-353d-41b6-a966-1acd03236673 tempest-VolumesTransfersV357Test-253659674 None] Created volume successfully.
Jul 06 20:56:12 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:12 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Acquiring lock "cinder-ebc2da55-e022-4737-a897-e8f5dae76a02-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-ebc2da55-e022-4737-a897-e8f5dae76a02-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Acquiring lock "cinder-quobyte-ebc2da55-e022-4737-a897-e8f5dae76a02" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-quobyte-ebc2da55-e022-4737-a897-e8f5dae76a02" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b5615e-3957-49a4-8d30-4d5f1350321b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:14 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 0 in 1.363s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:14 devstack sudo[97652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02
Jul 06 20:56:14 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:14 devstack sudo[97653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:14 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:15 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02" returned: 0 in 1.369s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:15 devstack sudo[97662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02
Jul 06 20:56:15 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:15 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 1 in 1.657s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:56:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 2G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd 2G" returned: 0 in 0.180s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.268s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c5d6f103-c9d4-47e2-a088-463caab05c88 tempest-VolumesExtendTest-1595222929 None] Extend volume completed successfully.
Jul 06 20:56:17 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ebc2da55-e022-4737-a897-e8f5dae76a02" returned: 0 in 1.617s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-quobyte-ebc2da55-e022-4737-a897-e8f5dae76a02" released by "delete_volume" :: held 3.081s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "cinder-42f8abf9-d92f-4360-8579-efe2a41b59cd-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-42f8abf9-d92f-4360-8579-efe2a41b59cd-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Created reservations ['29660891-ba04-465b-bf35-504f0325cb44', 'ac77e29b-7993-4343-8bce-cb06bd5fdc3b', 'd768d2ae-618c-43db-a180-c41ad9e8efcf', 'ee8033dc-d38b-4feb-a0c5-495ad7931af5'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "cinder-quobyte-42f8abf9-d92f-4360-8579-efe2a41b59cd" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-42f8abf9-d92f-4360-8579-efe2a41b59cd" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0be3229-119a-4286-9249-79f7dfb34121]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:17 devstack sudo[97672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:17 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:17 devstack sudo[97675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:17 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:18 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.415s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:18 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Deleted volume successfully.
Jul 06 20:56:18 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-192d569d-856f-4f76-986b-89c67fab30f7 tempest-VolumesTransfersV357Test-1269881345 None] Lock "cinder-ebc2da55-e022-4737-a897-e8f5dae76a02-delete_volume" released by "delete_volume" :: held 5.009s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 0 in 1.424s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:19 devstack sudo[97681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:19 devstack sudo[97681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:19 devstack sudo[97681]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 1 in 1.013s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:56:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:19 devstack sudo[97687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd
Jul 06 20:56:19 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:20 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-42f8abf9-d92f-4360-8579-efe2a41b59cd" returned: 0 in 0.981s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-42f8abf9-d92f-4360-8579-efe2a41b59cd" released by "delete_volume" :: held 3.631s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:20 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=96,cinder:SELECT=89,cinder:DELETE=7,cinder:INSERT=24 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:56:20 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=70,cinder:UPDATE=89,cinder:INSERT=29,cinder:DELETE=9 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:56:21 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Created reservations ['a9f69998-1662-4b16-aedf-f746c32d474e', 'fe32fd04-abf0-4abd-b5df-b8866dd3b240', '34402ba0-c9f4-43ac-bd3a-e237be368f17', '8d0c4b50-9fc5-4714-b643-10d82778b8f3'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:21 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:21 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:22 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.181s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:22 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Deleted volume successfully.
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b369dbee-78e3-49f3-b61a-204658308313 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-42f8abf9-d92f-4360-8579-efe2a41b59cd-delete_volume" released by "delete_volume" :: held 5.273s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Flow 'volume_create_manager' (fdcf5114-8b5e-4dff-8319-26a1b46fcba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1216888-f386-4fa5-a52d-a29b47d1b3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1216888-f386-4fa5-a52d-a29b47d1b3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-992400937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167789a6-47cf-4800-b787-b191c3036a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b193db499746318a18651ff4d5c0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:23Z,use_quota=True,user_id='fd9bb563a42343fdb845181ce572e44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8edd1d-71d8-46df-aef1-2b2438b7d5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e8edd1d-71d8-46df-aef1-2b2438b7d5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e35841-e526-4063-a638-3024070b9dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e35841-e526-4063-a638-3024070b9dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167789a6-47cf-4800-b787-b191c3036a63', 'volume_name': 'volume-167789a6-47cf-4800-b787-b191c3036a63', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a209d675-1c2b-48d6-a9b8-b2afaec76bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a209d675-1c2b-48d6-a9b8-b2afaec76bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38d3e6e-5dc2-4b92-94df-29b131e99ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Volume 167789a6-47cf-4800-b787-b191c3036a63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167789a6-47cf-4800-b787-b191c3036a63', 'volume_size': 1}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-992400937',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167789a6-47cf-4800-b787-b191c3036a63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20b193db499746318a18651ff4d5c0a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:23Z,use_quota=True,user_id='fd9bb563a42343fdb845181ce572e44c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Creating volume 167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:56:23 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:56:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:23 devstack sudo[97700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 1073741824
Jul 06 20:56:23 devstack sudo[97700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:24 devstack sudo[97700]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 1073741824" returned: 0 in 1.258s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:24 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63
Jul 06 20:56:24 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:25 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63" returned: 0 in 0.827s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38d3e6e-5dc2-4b92-94df-29b131e99ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167789a6-47cf-4800-b787-b191c3036a63', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2af177-9c53-40cb-ab8b-06b2d1065a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Volume volume-167789a6-47cf-4800-b787-b191c3036a63 (167789a6-47cf-4800-b787-b191c3036a63): created successfully
Jul 06 20:56:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c2af177-9c53-40cb-ab8b-06b2d1065a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Flow 'volume_create_manager' (fdcf5114-8b5e-4dff-8319-26a1b46fcba8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7d4ea19d-9b1b-433d-b6db-c41a7fdbebea tempest-VolumesExtendTest-1595222929 None] Created volume successfully.
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Creating offline snapshot 47e5eab6-0d9c-497a-a2c4-c9573a232ae2 of volume 167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[79047c50-8752-41d9-a85d-d9992a46fca8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:26 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63
Jul 06 20:56:26 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Flow 'volume_create_manager' (e977c6fa-2b16-4107-bfec-830ebecd30bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602a6ead-8e71-44ec-9c02-359ef1326086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (602a6ead-8e71-44ec-9c02-359ef1326086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-967943167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac4c19b-a1f4-423c-82db-6caa733dcdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6140873878b49dd9e491d4473ec56b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:27Z,use_quota=True,user_id='2e03bda471ef403baa14c0532a504993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c819b3b-8f7f-4943-82a2-94ddd011824f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c819b3b-8f7f-4943-82a2-94ddd011824f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa47e4a-b9fb-4f78-9867-c7a0d937c878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa47e4a-b9fb-4f78-9867-c7a0d937c878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac4c19b-a1f4-423c-82db-6caa733dcdef', 'volume_name': 'volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef', 'volume_size': 2}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f57bf96-b93d-4a89-94ba-dc4197496d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f57bf96-b93d-4a89-94ba-dc4197496d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3078e3e5-c7e9-4f62-8db7-1c84dd5fdb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Volume 1ac4c19b-a1f4-423c-82db-6caa733dcdef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef', 'volume_size': 2}
Jul 06 20:56:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:27 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63" returned: 0 in 0.825s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:27 devstack sudo[97739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 1G
Jul 06 20:56:27 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:27 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 1G" returned: 0 in 0.749s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167789a6-47cf-4800-b787-b191c3036a63 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:27 devstack sudo[97746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167789a6-47cf-4800-b787-b191c3036a63 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2
Jul 06 20:56:27 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:28 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-167789a6-47cf-4800-b787-b191c3036a63 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2" returned: 0 in 0.699s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:28 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 is being set with open permissions: ugo+rw
Jul 06 20:56:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:28 devstack sudo[97751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2
Jul 06 20:56:28 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:29 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2" returned: 0 in 0.636s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:29 devstack sudo[97754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.info
Jul 06 20:56:29 devstack sudo[97754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:29 devstack sudo[97754]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.info" returned: 0 in 0.671s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:29 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.info is being set with open permissions: ugo+rw
Jul 06 20:56:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:29 devstack sudo[97757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.info
Jul 06 20:56:29 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:30 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.info" returned: 0 in 0.649s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.330s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.793s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-967943167',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac4c19b-a1f4-423c-82db-6caa733dcdef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6140873878b49dd9e491d4473ec56b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:27Z,use_quota=True,user_id='2e03bda471ef403baa14c0532a504993',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Creating volume 1ac4c19b-a1f4-423c-82db-6caa733dcdef {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:56:30 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:56:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef 2147483648 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:30 devstack sudo[97760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef 2147483648
Jul 06 20:56:30 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-05404b2d-5a6c-4b75-9f9e-22c045aa2f65 tempest-VolumesExtendTest-1595222929 None] Create snapshot completed successfully
Jul 06 20:56:31 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef 2147483648" returned: 0 in 0.849s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:31 devstack sudo[97766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef
Jul 06 20:56:31 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:32 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef" returned: 0 in 0.629s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.545s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[73c2fd9c-1f80-4f38-b6a3-54430153f988]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3078e3e5-c7e9-4f62-8db7-1c84dd5fdb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef', 'volume_size': 2}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7079662c-4cb2-4fd3-a8b2-eb9288dfc59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:32 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Volume volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef (1ac4c19b-a1f4-423c-82db-6caa733dcdef): created successfully
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7079662c-4cb2-4fd3-a8b2-eb9288dfc59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Flow 'volume_create_manager' (e977c6fa-2b16-4107-bfec-830ebecd30bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8fa52eb2-088b-4cda-9043-82279bf91502 tempest-VolumesCloneNegativeTest-1902007048 None] Created volume successfully.
Jul 06 20:56:32 devstack sudo[97769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63
Jul 06 20:56:32 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:32 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63" returned: 0 in 0.768s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 2G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 2G" returned: 0 in 0.133s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.935s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:33 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fcad3032-02ca-4205-bb15-10fdcf2cd201 tempest-VolumesExtendTest-1595222929 None] Extend volume completed successfully.
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Acquiring lock "cinder-1ac4c19b-a1f4-423c-82db-6caa733dcdef-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "cinder-1ac4c19b-a1f4-423c-82db-6caa733dcdef-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Acquiring lock "cinder-quobyte-1ac4c19b-a1f4-423c-82db-6caa733dcdef" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "cinder-quobyte-1ac4c19b-a1f4-423c-82db-6caa733dcdef" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10917fb7-49b8-48c7-9722-163bf44b0a4c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:33 devstack sudo[97778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef
Jul 06 20:56:33 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "cinder-47e5eab6-0d9c-497a-a2c4-c9573a232ae2-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-47e5eab6-0d9c-497a-a2c4-c9573a232ae2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "cinder-quobyte-167789a6-47cf-4800-b787-b191c3036a63" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-167789a6-47cf-4800-b787-b191c3036a63" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "cinder-quobyte-47e5eab6-0d9c-497a-a2c4-c9573a232ae2" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-47e5eab6-0d9c-497a-a2c4-c9573a232ae2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Deleting offline snapshot 47e5eab6-0d9c-497a-a2c4-c9573a232ae2 of volume 167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] snapshot_file for this snap is: volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5779c987-e5a2-4dd0-927f-89c4b54188a3]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:34 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef" returned: 0 in 0.820s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:34 devstack sudo[97784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef
Jul 06 20:56:34 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:34 devstack sudo[97783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2
Jul 06 20:56:34 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:34 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1ac4c19b-a1f4-423c-82db-6caa733dcdef" returned: 0 in 0.674s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "cinder-quobyte-1ac4c19b-a1f4-423c-82db-6caa733dcdef" released by "delete_volume" :: held 1.540s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Created reservations ['0abfa966-d45e-422c-92ea-ea7980f7ee68', 'ce6033d0-1123-45d5-aeab-917187b60c51', 'c2a2d744-17f4-4404-b5e7-a9db43674459', 'e0175b5e-bce1-4e9d-b344-5984f06061a1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:34 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2" returned: 0 in 0.866s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-167789a6-47cf-4800-b787-b191c3036a63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7073a15-d183-4bc9-9d88-f806f4c3723c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:34 devstack sudo[97792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:34 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:34 devstack sudo[97791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63
Jul 06 20:56:34 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:35 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.751s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:35 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Deleted volume successfully.
Jul 06 20:56:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b0ab364e-b75a-4867-a393-5863665f1c11 tempest-VolumesCloneNegativeTest-1902007048 None] Lock "cinder-1ac4c19b-a1f4-423c-82db-6caa733dcdef-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:35 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63" returned: 0 in 0.898s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:35 devstack sudo[97799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2
Jul 06 20:56:35 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:36 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2" returned: 0 in 0.903s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:36 devstack sudo[97804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2
Jul 06 20:56:36 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:37 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63.47e5eab6-0d9c-497a-a2c4-c9573a232ae2" returned: 0 in 0.727s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-47e5eab6-0d9c-497a-a2c4-c9573a232ae2" released by "_delete_snapshot" :: held 3.507s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-167789a6-47cf-4800-b787-b191c3036a63" released by "delete_snapshot" :: held 3.531s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Created reservations ['9639968e-3a7a-4973-bd7c-faf995a7ef7c', '57cc2bbd-3e41-44f7-81ec-5092607520ae', '230c2c5d-78cf-4801-8cf8-88ca8f409add', '34b335a3-4e9c-400f-96c7-04274565ff8c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Delete snapshot completed successfully.
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b020fa41-3f9a-49df-be4b-557c5a210739 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-47e5eab6-0d9c-497a-a2c4-c9573a232ae2-delete_snapshot" released by "delete_snapshot" :: held 3.691s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:37 devstack sudo[97808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:37 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "cinder-167789a6-47cf-4800-b787-b191c3036a63-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-167789a6-47cf-4800-b787-b191c3036a63-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:38 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.729s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "cinder-quobyte-167789a6-47cf-4800-b787-b191c3036a63" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-167789a6-47cf-4800-b787-b191c3036a63" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f165f0-40e6-4ed8-b721-5e1b2c110ae7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:38 devstack sudo[97813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63
Jul 06 20:56:38 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (87d37a32-c8f0-401e-a41f-de9f3556be30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaebd38-3aec-4801-a63e-b9c93c408bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaebd38-3aec-4801-a63e-b9c93c408bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1978743067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242c4cad-33bf-44ba-aa9b-d69e0ad80f09,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:39Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1b88dc-2d65-44dc-9dd8-4d31a83869fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1b88dc-2d65-44dc-9dd8-4d31a83869fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14dd4754-cb44-4ca5-a634-4f5041b844a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14dd4754-cb44-4ca5-a634-4f5041b844a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '242c4cad-33bf-44ba-aa9b-d69e0ad80f09', 'volume_name': 'volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8521d805-5e3b-4de5-81f3-25f288405369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8521d805-5e3b-4de5-81f3-25f288405369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb6ace8-1c57-4e62-b52c-2b64911920c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Volume 242c4cad-33bf-44ba-aa9b-d69e0ad80f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09', 'volume_size': 1}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1978743067',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=242c4cad-33bf-44ba-aa9b-d69e0ad80f09,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:39Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Creating volume 242c4cad-33bf-44ba-aa9b-d69e0ad80f09 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:56:38 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:56:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:38 devstack sudo[97817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09 1073741824
Jul 06 20:56:38 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:39 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63" returned: 0 in 0.844s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:39 devstack sudo[97824]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63
Jul 06 20:56:39 devstack sudo[97824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:39 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09 1073741824" returned: 0 in 0.913s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:39 devstack sudo[97829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09
Jul 06 20:56:39 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:40 devstack sudo[97824]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-167789a6-47cf-4800-b787-b191c3036a63" returned: 0 in 0.703s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-quobyte-167789a6-47cf-4800-b787-b191c3036a63" released by "delete_volume" :: held 1.656s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Created reservations ['d1578733-c970-45fe-a83a-9db5e929fd9e', '4c401969-f8e4-4b21-a41b-86bd646c8479', 'b3272ed6-14f2-47ed-afe9-6a17560fad6f', '92f9a34e-1767-4886-83e7-2c72ce73bc73'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:40 devstack sudo[97836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:40 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:40 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deb6ace8-1c57-4e62-b52c-2b64911920c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c462a04-8a3c-4f58-944d-632b4de00007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:40 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Volume volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09 (242c4cad-33bf-44ba-aa9b-d69e0ad80f09): created successfully
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c462a04-8a3c-4f58-944d-632b4de00007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (87d37a32-c8f0-401e-a41f-de9f3556be30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c7f81158-6518-4688-a4fd-52e5bda3a6ea tempest-VolumesGetTest-959458932 None] Created volume successfully.
Jul 06 20:56:41 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.023s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Deleted volume successfully.
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-40a6755b-4840-4f11-b905-63015a757873 tempest-VolumesExtendTest-1595222929 None] Lock "cinder-167789a6-47cf-4800-b787-b191c3036a63-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (2619e781-c71e-454c-8886-df51ddee0894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2378f7de-22a6-4c89-b5cc-58f397537935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2378f7de-22a6-4c89-b5cc-58f397537935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773877179',display_name='tempest-VolumesGetTest-Volume-1851628370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4787e4aa-c7b0-4811-be2c-0dc99fa1913e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:42Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a532a0d-8ea7-446e-b8d4-7e28a4c11c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a532a0d-8ea7-446e-b8d4-7e28a4c11c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00a0a3e-928d-4450-8e34-a11869f03748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a00a0a3e-928d-4450-8e34-a11869f03748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4787e4aa-c7b0-4811-be2c-0dc99fa1913e', 'volume_name': 'volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cbbb2e-c625-4d82-bbeb-5c05dd7e7a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5cbbb2e-c625-4d82-bbeb-5c05dd7e7a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc90093-8445-4738-bddd-05517e2040dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Volume 4787e4aa-c7b0-4811-be2c-0dc99fa1913e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e', 'volume_size': 1}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-773877179',display_name='tempest-VolumesGetTest-Volume-1851628370',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4787e4aa-c7b0-4811-be2c-0dc99fa1913e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:42Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Creating volume 4787e4aa-c7b0-4811-be2c-0dc99fa1913e {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:56:41 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:56:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:41 devstack sudo[97862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e 1073741824
Jul 06 20:56:41 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:42 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e 1073741824" returned: 0 in 0.913s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:42 devstack sudo[97869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e
Jul 06 20:56:42 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:43 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e" returned: 0 in 0.699s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc90093-8445-4738-bddd-05517e2040dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65eac27d-91e7-4d08-ab96-48416115b9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Volume volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e (4787e4aa-c7b0-4811-be2c-0dc99fa1913e): created successfully
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65eac27d-91e7-4d08-ab96-48416115b9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (2619e781-c71e-454c-8886-df51ddee0894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-08d7acf9-1c14-4c13-84ff-25670abe2c22 tempest-VolumesGetTest-959458932 None] Created volume successfully.
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-4787e4aa-c7b0-4811-be2c-0dc99fa1913e-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Lock "cinder-4787e4aa-c7b0-4811-be2c-0dc99fa1913e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-4787e4aa-c7b0-4811-be2c-0dc99fa1913e" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-4787e4aa-c7b0-4811-be2c-0dc99fa1913e" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[44142ad5-d63e-466b-97ae-4e4636ac6e90]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:44 devstack sudo[97872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e
Jul 06 20:56:44 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:44 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e" returned: 0 in 0.830s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:44 devstack sudo[97877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e
Jul 06 20:56:44 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:45 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4787e4aa-c7b0-4811-be2c-0dc99fa1913e" returned: 0 in 0.705s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-4787e4aa-c7b0-4811-be2c-0dc99fa1913e" released by "delete_volume" :: held 1.584s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Created reservations ['4c32a0b1-5382-4d1c-a241-3cd67b9e8a33', '104053a2-5db3-4604-9dcd-fa0f4d2dd381', '9ee2ea9f-2a3d-4779-89cf-74bfbb1074b5', 'd39a358e-d5fc-4977-94f9-bdbe2c350936'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:45 devstack sudo[97880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:45 devstack sudo[97880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-242c4cad-33bf-44ba-aa9b-d69e0ad80f09-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Lock "cinder-242c4cad-33bf-44ba-aa9b-d69e0ad80f09-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-242c4cad-33bf-44ba-aa9b-d69e0ad80f09" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-242c4cad-33bf-44ba-aa9b-d69e0ad80f09" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aef7c46-d0e0-4ef7-b219-5e3314f3f90e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:46 devstack sudo[97880]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.793s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Deleted volume successfully.
Jul 06 20:56:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2582d042-5c48-47b3-8c98-b9de1f887d15 tempest-VolumesGetTest-959458932 None] Lock "cinder-4787e4aa-c7b0-4811-be2c-0dc99fa1913e-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:46 devstack sudo[97883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09
Jul 06 20:56:46 devstack sudo[97883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:47 devstack sudo[97883]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09" returned: 0 in 0.913s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:47 devstack sudo[97889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09
Jul 06 20:56:47 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:48 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-242c4cad-33bf-44ba-aa9b-d69e0ad80f09" returned: 0 in 0.676s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-242c4cad-33bf-44ba-aa9b-d69e0ad80f09" released by "delete_volume" :: held 1.646s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Created reservations ['e017b11f-c453-4c69-9a01-01804061714d', '23581fc9-caae-4544-9977-65b5b82c7d9a', 'abc832b6-8336-4a03-a708-86233ac02722', 'bda1a460-0dfb-464d-803a-c1b60b4b91fb'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:48 devstack sudo[97893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:56:48 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-7d7fa748-ecb8-494f-a16e-e1814d11dc5f req-745f0b90-c327-434c-be44-7492498dbab9 tempest-AttachVolumeNegativeTest-75244407 None] Terminate volume connection completed successfully.
Jul 06 20:56:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-7d7fa748-ecb8-494f-a16e-e1814d11dc5f req-745f0b90-c327-434c-be44-7492498dbab9 tempest-AttachVolumeNegativeTest-75244407 None] Deleting attachment 3cc3b73d-a1a5-4a38-a5e0-aa265e461e85. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:56:49 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (97f0bd64-26f3-4b17-b599-38e4193fb1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7519057-0d24-4eea-aab0-eed20570a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.897s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:56:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Deleted volume successfully.
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7519057-0d24-4eea-aab0-eed20570a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1974369851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ea637b-716b-4ec6-ae58-cd6ff7c39566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:49Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92ad802-a34e-4a56-ab38-fc804e4cf694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92ad802-a34e-4a56-ab38-fc804e4cf694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93536229-b593-4852-94b2-6a2562fd07a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93536229-b593-4852-94b2-6a2562fd07a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ea637b-716b-4ec6-ae58-cd6ff7c39566', 'volume_name': 'volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f126a7f-70e8-4c1e-9353-3610bbe78ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f126a7f-70e8-4c1e-9353-3610bbe78ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97456a2-2e1f-4179-8dfc-f3a64396c212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:49 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Volume c0ea637b-716b-4ec6-ae58-cd6ff7c39566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566', 'volume_size': 1}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1974369851',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ea637b-716b-4ec6-ae58-cd6ff7c39566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:49Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Creating volume c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:56:49 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:49 devstack sudo[97899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 1073741824
Jul 06 20:56:49 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-61cfca0e-9166-41e0-8b15-29279c87d117 tempest-VolumesGetTest-959458932 None] Lock "cinder-242c4cad-33bf-44ba-aa9b-d69e0ad80f09-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:56:50 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 1073741824" returned: 0 in 1.055s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:50 devstack sudo[97905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566
Jul 06 20:56:50 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:51 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" returned: 0 in 0.908s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] <== create_volume: return (2014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:56:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e97456a2-2e1f-4179-8dfc-f3a64396c212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86870fd-4224-4d28-a8a9-44fe5db98435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Volume volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 (c0ea637b-716b-4ec6-ae58-cd6ff7c39566): created successfully
Jul 06 20:56:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e86870fd-4224-4d28-a8a9-44fe5db98435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (97f0bd64-26f3-4b17-b599-38e4193fb1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a525cb63-2867-4db6-b6c9-bde393896d7d tempest-VolumesGetTest-959458932 None] Created volume successfully.
Jul 06 20:56:52 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (729ee2f8-a016-4d57-bba8-a2594688dae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ddf007-9afc-4f86-a2c1-4fd6dd6b2b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ddf007-9afc-4f86-a2c1-4fd6dd6b2b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2091175901',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1501d8a6-e4f7-4837-bb68-fa65049a9de4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=c0ea637b-716b-4ec6-ae58-cd6ff7c39566,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:53Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc35961-051b-4cbc-a0bc-0a71f182eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbc35961-051b-4cbc-a0bc-0a71f182eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a78e4-4a09-4dbf-aa06-bcb815f420d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b5a78e4-4a09-4dbf-aa06-bcb815f420d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1501d8a6-e4f7-4837-bb68-fa65049a9de4', 'volume_name': 'volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4', 'volume_size': 1, 'source_volid': 'c0ea637b-716b-4ec6-ae58-cd6ff7c39566', 'source_volstatus': 'available'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879b4b14-fffc-47da-b6ad-8a1bdaac792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (879b4b14-fffc-47da-b6ad-8a1bdaac792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869bba9-515d-454a-a1f2-f8eb75280ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Volume 1501d8a6-e4f7-4837-bb68-fa65049a9de4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4', 'volume_size': 1, 'source_volid': 'c0ea637b-716b-4ec6-ae58-cd6ff7c39566', 'source_volstatus': 'available'}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:53 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Cloning volume c0ea637b-716b-4ec6-ae58-cd6ff7c39566 to volume 1501d8a6-e4f7-4837-bb68-fa65049a9de4
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Creating offline snapshot 1d58c315-3a91-4abb-b123-cd0dfd89b7b5 of volume c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e326eff-fc8b-4be2-a023-f4aa527693c3]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:53 devstack sudo[97930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566
Jul 06 20:56:53 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:54 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" returned: 0 in 0.956s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:54 devstack sudo[97937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 1G
Jul 06 20:56:54 devstack sudo[97937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:55 devstack sudo[97937]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 1G" returned: 0 in 0.949s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:55 devstack sudo[97944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5
Jul 06 20:56:55 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (34ae0fb4-0781-4f5e-a3d4-3921bd1c65df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9234bd-aff3-4de1-b30d-452d11ed690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9234bd-aff3-4de1-b30d-452d11ed690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1645237824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820063a5-1745-4eb2-bd5b-f518f54eaf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:55Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa7d3e4-2634-4bc7-b7d9-4be4dd2fae2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa7d3e4-2634-4bc7-b7d9-4be4dd2fae2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c4e214-110d-48ae-aa5c-3f6e77f2131e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c4e214-110d-48ae-aa5c-3f6e77f2131e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820063a5-1745-4eb2-bd5b-f518f54eaf7c', 'volume_name': 'volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272c2edd-3481-4604-8824-ec7f771c2968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272c2edd-3481-4604-8824-ec7f771c2968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374706fb-db11-4071-8efd-f921ece1eb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:56:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume 820063a5-1745-4eb2-bd5b-f518f54eaf7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c', 'volume_size': 1}
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:55 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5" returned: 0 in 0.755s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:55 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 is being set with open permissions: ugo+rw
Jul 06 20:56:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:55 devstack sudo[97949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5
Jul 06 20:56:55 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:56 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5" returned: 0 in 0.650s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:56 devstack sudo[97953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.info
Jul 06 20:56:56 devstack sudo[97953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:57 devstack sudo[97953]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.info" returned: 0 in 0.652s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:57 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.info is being set with open permissions: ugo+rw
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:57 devstack sudo[97956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.info
Jul 06 20:56:57 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:57 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.info" returned: 0 in 0.658s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-1501d8a6-e4f7-4837-bb68-fa65049a9de4" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1501d8a6-e4f7-4837-bb68-fa65049a9de4" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] snapshot: 1d58c315-3a91-4abb-b123-cd0dfd89b7b5, volume: 1501d8a6-e4f7-4837-bb68-fa65049a9de4,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[045e562b-6c28-403f-9488-c2bf22ce9864]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:58 devstack sudo[97960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5
Jul 06 20:56:58 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:58 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5" returned: 0 in 0.839s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:56:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:56:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:56:58 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90b18ce-95a3-47ca-b8d9-9432f96d4e8a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:56:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:58 devstack sudo[97965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566
Jul 06 20:56:58 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:56:59 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root
Jul 06 20:56:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" returned: 0 in 0.831s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:56:59 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:56:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:56:59 devstack sudo[97970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4
Jul 06 20:56:59 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:04 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4" returned: 0 in 5.348s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c9520b-c06b-4660-bb25-e5d09f304176]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:05 devstack sudo[97987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566
Jul 06 20:57:05 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:05 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" returned: 0 in 0.950s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:05 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:57:05 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Converted 1024.00 MB image at 191.41 MB/s
Jul 06 20:57:05 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 is being set with open permissions: ugo+rw
Jul 06 20:57:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:05 devstack sudo[97992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4
Jul 06 20:57:05 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:06 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4" returned: 0 in 0.678s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1501d8a6-e4f7-4837-bb68-fa65049a9de4" released by "_copy_volume_from_snapshot" :: held 8.735s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-1d58c315-3a91-4abb-b123-cd0dfd89b7b5" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1d58c315-3a91-4abb-b123-cd0dfd89b7b5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Deleting offline snapshot 1d58c315-3a91-4abb-b123-cd0dfd89b7b5 of volume c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] snapshot_file for this snap is: volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d174def5-7b36-4914-a71b-eaed736ccd49]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:06 devstack sudo[97995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5
Jul 06 20:57:06 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:07 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5" returned: 0 in 0.829s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:57:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3501c0b-b2a6-4a4a-bf2d-5c19c65cc8f0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:07 devstack sudo[98036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566
Jul 06 20:57:07 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:08 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" returned: 0 in 0.759s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:08 devstack sudo[98042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5
Jul 06 20:57:08 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:09 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5" returned: 0 in 0.773s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:09 devstack sudo[98048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5
Jul 06 20:57:09 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:09 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566.1d58c315-3a91-4abb-b123-cd0dfd89b7b5" returned: 0 in 0.739s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1d58c315-3a91-4abb-b123-cd0dfd89b7b5" released by "_delete_snapshot" :: held 3.221s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.810s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.425s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1645237824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820063a5-1745-4eb2-bd5b-f518f54eaf7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:56:55Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating volume 820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:09 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:57:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:10 devstack sudo[98051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c 1073741824
Jul 06 20:57:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8869bba9-515d-454a-a1f2-f8eb75280ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4', 'volume_size': 1, 'source_volid': 'c0ea637b-716b-4ec6-ae58-cd6ff7c39566', 'source_volstatus': 'available'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:10 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74412cae-b4fe-4a1c-bc40-5aad213d3ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:10 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Volume volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 (1501d8a6-e4f7-4837-bb68-fa65049a9de4): created successfully
Jul 06 20:57:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74412cae-b4fe-4a1c-bc40-5aad213d3ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (729ee2f8-a016-4d57-bba8-a2594688dae2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-89d0ed69-4681-46d9-8556-206c851cd4b9 tempest-VolumesGetTest-959458932 None] Created volume successfully.
Jul 06 20:57:10 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c 1073741824" returned: 0 in 0.964s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:11 devstack sudo[98061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c
Jul 06 20:57:11 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:11 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c" returned: 0 in 0.734s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:57:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (374706fb-db11-4071-8efd-f921ece1eb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0684ad42-9e23-4f12-86ad-9f2ba3762ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:11 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c (820063a5-1745-4eb2-bd5b-f518f54eaf7c): created successfully
Jul 06 20:57:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0684ad42-9e23-4f12-86ad-9f2ba3762ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (34ae0fb4-0781-4f5e-a3d4-3921bd1c65df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-58cf15d8-a019-41c6-812c-45d38733f079 tempest-VolumesSnapshotTestJSON-1975442814 None] Created volume successfully.
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (042c52ed-f8a2-4a51-a634-60fc5b2033fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8f8e8d-9244-44c2-88cc-b885c222f741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c8f8e8d-9244-44c2-88cc-b885c222f741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-980138472',display_name='tempest-VolumesGetTest-Volume-2101789955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edced5cb-d733-41d5-adb3-6b7ef92f02ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:12Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85fda71-9ce9-4461-989a-61119c3f3814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85fda71-9ce9-4461-989a-61119c3f3814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8974c8e-462c-47c7-b2b2-d227e83fb36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8974c8e-462c-47c7-b2b2-d227e83fb36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edced5cb-d733-41d5-adb3-6b7ef92f02ad', 'volume_name': 'volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421b680e-347d-40f1-a5ce-bb288c82bed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (421b680e-347d-40f1-a5ce-bb288c82bed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0377d350-b0e8-4eab-86ac-f87086798473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Volume edced5cb-d733-41d5-adb3-6b7ef92f02ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad', 'volume_size': 1}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-980138472',display_name='tempest-VolumesGetTest-Volume-2101789955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edced5cb-d733-41d5-adb3-6b7ef92f02ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:12Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Creating volume edced5cb-d733-41d5-adb3-6b7ef92f02ad {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:12 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:57:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:12 devstack sudo[98079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad 1073741824
Jul 06 20:57:12 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:13 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad 1073741824" returned: 0 in 0.903s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:13 devstack sudo[98085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad
Jul 06 20:57:13 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:13 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad" returned: 0 in 0.659s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.675s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating offline snapshot cfd3f320-b917-4d35-b04b-af5b561842ee of volume 820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0377d350-b0e8-4eab-86ac-f87086798473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70d9563-1f67-4d0a-abc8-63def18e97c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd012a1-9c32-40e5-b4c7-ee0a5a29dda4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:13 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Volume volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad (edced5cb-d733-41d5-adb3-6b7ef92f02ad): created successfully
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70d9563-1f67-4d0a-abc8-63def18e97c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (042c52ed-f8a2-4a51-a634-60fc5b2033fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a8d78a23-836d-4004-92d4-f0c31ac99b33 tempest-VolumesGetTest-959458932 None] Created volume successfully.
Jul 06 20:57:13 devstack sudo[98088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c
Jul 06 20:57:13 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-edced5cb-d733-41d5-adb3-6b7ef92f02ad-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Lock "cinder-edced5cb-d733-41d5-adb3-6b7ef92f02ad-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-edced5cb-d733-41d5-adb3-6b7ef92f02ad" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-edced5cb-d733-41d5-adb3-6b7ef92f02ad" acquired by "delete_volume" :: waited 0.040s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a03eca-79fd-4d1a-a664-c0a821dc3e3d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:14 devstack sudo[98103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad
Jul 06 20:57:14 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:14 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c" returned: 0 in 0.946s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:14 devstack sudo[98128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee 1G
Jul 06 20:57:14 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:15 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad" returned: 0 in 1.168s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:15 devstack sudo[98152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad
Jul 06 20:57:15 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:15 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee 1G" returned: 0 in 1.114s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:15 devstack sudo[98155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee
Jul 06 20:57:15 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:16 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-edced5cb-d733-41d5-adb3-6b7ef92f02ad" returned: 0 in 0.718s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-edced5cb-d733-41d5-adb3-6b7ef92f02ad" released by "delete_volume" :: held 1.971s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Created reservations ['81be510f-f97d-4eda-9bc4-8fdf5d92774b', '142d5588-057b-4f36-8dfc-4e833e6db238', 'dda18497-b0b2-474b-b180-913203f1e56d', '829de1f2-d5fe-48d9-9194-cf269b4cdc37'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:16 devstack sudo[98181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:16 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:16 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee" returned: 0 in 0.848s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:16 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee is being set with open permissions: ugo+rw
Jul 06 20:57:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:16 devstack sudo[98183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee
Jul 06 20:57:16 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:17 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:17 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Deleted volume successfully.
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1da9d0d6-b896-4f40-a66b-4b4a9a5db986 tempest-VolumesGetTest-959458932 None] Lock "cinder-edced5cb-d733-41d5-adb3-6b7ef92f02ad-delete_volume" released by "delete_volume" :: held 3.040s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:17 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee" returned: 0 in 0.726s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:17 devstack sudo[98189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.info
Jul 06 20:57:17 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-1501d8a6-e4f7-4837-bb68-fa65049a9de4-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Lock "cinder-1501d8a6-e4f7-4837-bb68-fa65049a9de4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-1501d8a6-e4f7-4837-bb68-fa65049a9de4" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1501d8a6-e4f7-4837-bb68-fa65049a9de4" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[44498812-c4e4-4c92-8c14-5ba8dc5aaa1b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:18 devstack sudo[98192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4
Jul 06 20:57:18 devstack sudo[98192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:18 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.info" returned: 0 in 0.817s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:18 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.info is being set with open permissions: ugo+rw
Jul 06 20:57:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:18 devstack sudo[98195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.info
Jul 06 20:57:18 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:18 devstack sudo[98192]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4" returned: 0 in 0.926s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:18 devstack sudo[98201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4
Jul 06 20:57:18 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:19 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.info" returned: 0 in 0.735s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.294s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:19 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0ed41726-1e00-4394-a2e5-df9b8a3dd081 tempest-VolumesSnapshotTestJSON-1975442814 None] Create snapshot completed successfully
Jul 06 20:57:19 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1501d8a6-e4f7-4837-bb68-fa65049a9de4" returned: 0 in 0.750s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1501d8a6-e4f7-4837-bb68-fa65049a9de4" released by "delete_volume" :: held 1.745s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-cfd3f320-b917-4d35-b04b-af5b561842ee-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-cfd3f320-b917-4d35-b04b-af5b561842ee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Created reservations ['a1eccfa7-0b30-4db3-b986-1d75e4d05eec', '685be55a-bc01-4c9a-922f-cada00fffb7c', '679eb16d-35a1-43d8-830e-3e29768a13ff', 'a4e88cfc-3788-439c-aa78-656635013de2'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-820063a5-1745-4eb2-bd5b-f518f54eaf7c" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-820063a5-1745-4eb2-bd5b-f518f54eaf7c" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-cfd3f320-b917-4d35-b04b-af5b561842ee" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-cfd3f320-b917-4d35-b04b-af5b561842ee" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleting offline snapshot cfd3f320-b917-4d35-b04b-af5b561842ee of volume 820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] snapshot_file for this snap is: volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[da00a17b-b391-4f18-a477-df36b6ce13cb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:20 devstack sudo[98205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:20 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:20 devstack sudo[98206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee
Jul 06 20:57:20 devstack sudo[98206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-c0ea637b-716b-4ec6-ae58-cd6ff7c39566-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Lock "cinder-c0ea637b-716b-4ec6-ae58-cd6ff7c39566-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dca952-d545-4144-915d-e9358f38e378]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:20 devstack sudo[98209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566
Jul 06 20:57:20 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:21 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.124s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Deleted volume successfully.
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=77,cinder:INSERT=28,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-388fbb80-dba8-493a-8284-daff46954e34 tempest-VolumesGetTest-959458932 None] Lock "cinder-1501d8a6-e4f7-4837-bb68-fa65049a9de4-delete_volume" released by "delete_volume" :: held 3.369s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:21 devstack sudo[98206]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee" returned: 0 in 1.245s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7285687-448c-4007-a08b-9f2b5dc662fc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:21 devstack sudo[98223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c
Jul 06 20:57:21 devstack sudo[98223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:21 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" returned: 0 in 1.199s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:21 devstack sudo[98228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566
Jul 06 20:57:21 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:22 devstack sudo[98223]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c" returned: 0 in 0.861s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:22 devstack sudo[98233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee
Jul 06 20:57:22 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:22 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" returned: 0 in 0.755s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-c0ea637b-716b-4ec6-ae58-cd6ff7c39566" released by "delete_volume" :: held 2.017s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=73,cinder:INSERT=16,cinder:UPDATE=92,cinder:DELETE=9 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Created reservations ['234518ae-fef7-4977-959c-9398da475982', '79edba65-98cd-4ded-a978-ced4937de90d', '50d32aa1-2602-4214-88b8-90053a2d0577', '43dbb568-488d-486b-a639-a14e672101a2'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:22 devstack sudo[98236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:22 devstack sudo[98236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:22 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee" returned: 0 in 0.834s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:22 devstack sudo[98241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee
Jul 06 20:57:22 devstack sudo[98241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:23 devstack sudo[98236]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.690s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Deleted volume successfully.
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd12b76a-5e78-4f40-bf8c-c8a48bb586c0 tempest-VolumesGetTest-959458932 None] Lock "cinder-c0ea637b-716b-4ec6-ae58-cd6ff7c39566-delete_volume" released by "delete_volume" :: held 2.995s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:23 devstack sudo[98241]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c.cfd3f320-b917-4d35-b04b-af5b561842ee" returned: 0 in 0.690s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-cfd3f320-b917-4d35-b04b-af5b561842ee" released by "_delete_snapshot" :: held 3.801s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-820063a5-1745-4eb2-bd5b-f518f54eaf7c" released by "delete_snapshot" :: held 3.859s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['1d95b6dc-a1bd-4eda-8fa7-35ea6d1e58cd', 'ddbd1b63-90b6-4dd7-9b4b-a6b7e5df48f4', '3af27f0a-e0cc-4d1a-9edf-2756d0913b29', '4692a3b0-ad24-42d3-bdfb-5b62fe1c89a0'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Delete snapshot completed successfully.
Jul 06 20:57:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d321d4c4-ec30-4f56-b305-106086281052 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-cfd3f320-b917-4d35-b04b-af5b561842ee-delete_snapshot" released by "delete_snapshot" :: held 4.116s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (767f90ca-4587-47da-a154-bf263afb1c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7da23c-4962-4302-ae48-2d0eb236334e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a7da23c-4962-4302-ae48-2d0eb236334e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-29682839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcabf40-e6e4-4399-9ba2-e62905e36a42,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:24Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4253d484-a297-4f41-af12-bd1b1647168a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4253d484-a297-4f41-af12-bd1b1647168a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afebc9a5-4465-44d7-bc2d-269c0c26bee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (0b9ff0de-23eb-4e54-8c18-d60703ac3ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90556d64-4757-48bb-8425-0ceb9796d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90556d64-4757-48bb-8425-0ceb9796d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-735016178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed2ee1c-3c80-45c5-8923-8a5bf60bac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:25Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d87352-a69c-41b9-af43-9ea59517bae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d87352-a69c-41b9-af43-9ea59517bae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172b23af-a543-4610-afa2-b23c3e473737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (172b23af-a543-4610-afa2-b23c3e473737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ed2ee1c-3c80-45c5-8923-8a5bf60bac41', 'volume_name': 'volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0c7567-e410-4b98-9fe6-d5c55191287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a0c7567-e410-4b98-9fe6-d5c55191287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c3c17d-9c29-46ba-b6d4-75d95188c0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:24 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume 2ed2ee1c-3c80-45c5-8923-8a5bf60bac41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41', 'volume_size': 1}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-735016178',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ed2ee1c-3c80-45c5-8923-8a5bf60bac41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:25Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating volume 2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:24 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:57:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:24 devstack sudo[98246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 1073741824
Jul 06 20:57:24 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afebc9a5-4465-44d7-bc2d-269c0c26bee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1bcabf40-e6e4-4399-9ba2-e62905e36a42', 'volume_name': 'volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec1e2bd0>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4702c0c-3fb8-42b4-9de4-a2db7eb27aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4702c0c-3fb8-42b4-9de4-a2db7eb27aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc8df7c-b2e2-4e14-8f3a-1c059adb11f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Volume 1bcabf40-e6e4-4399-9ba2-e62905e36a42: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec1e2bd0>}
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Trying to clone 1bcabf40-e6e4-4399-9ba2-e62905e36a42 from image 0acbb0cd-0336-492a-b73d-b152eae4e946 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 20:57:25 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d63629c-7392-4b42-a07a-96bef302fcf8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:25 devstack sudo[98252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD
Jul 06 20:57:25 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:25 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 1073741824" returned: 0 in 1.005s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:25 devstack sudo[98254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41
Jul 06 20:57:25 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:26 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 is fetched for user ee4e36e8e7104ff18c55c7435426c5dd. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41964db8-dba3-4e11-8dd5-7b694b141ecb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:26 devstack sudo[98259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD
Jul 06 20:57:26 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:26 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" returned: 0 in 0.700s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] <== create_volume: return (1756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16c3c17d-9c29-46ba-b6d4-75d95188c0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421081a6-6107-4bac-bbb4-2cf7fcad949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 (2ed2ee1c-3c80-45c5-8923-8a5bf60bac41): created successfully
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (421081a6-6107-4bac-bbb4-2cf7fcad949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (0b9ff0de-23eb-4e54-8c18-d60703ac3ab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0fe45a2a-408a-4d37-83ee-8f54ab11e381 tempest-VolumesSnapshotTestJSON-1975442814 None] Created volume successfully.
Jul 06 20:57:27 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD" returned: 0 in 0.809s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-29682839',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcabf40-e6e4-4399-9ba2-e62905e36a42,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:24Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Creating volume 1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:27 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:27 devstack sudo[98265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 1073741824
Jul 06 20:57:27 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:28 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 1073741824" returned: 0 in 0.892s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:28 devstack sudo[98272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42
Jul 06 20:57:28 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:28 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42" returned: 0 in 0.685s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.880s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Creating offline snapshot ceb34a95-3165-4a9b-8637-43cfbcb3489b of volume 2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Attempting download of 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume 1bcabf40-e6e4-4399-9ba2-e62905e36a42. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f6939-62fb-49e5-bfff-f42a7d06f6a8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4a0895-c438-465c-a89c-bd77e5845011]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_jiusmzv1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:29 devstack sudo[98275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41
Jul 06 20:57:29 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:29 devstack sudo[98276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_jiusmzv1
Jul 06 20:57:29 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:29 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_jiusmzv1" returned: 0 in 0.787s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_jiusmzv1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:29 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" returned: 0 in 0.898s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:29 devstack sudo[98303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b 1G
Jul 06 20:57:29 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:29 devstack sudo[98302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_jiusmzv1
Jul 06 20:57:29 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:30 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_jiusmzv1" returned: 1 in 0.738s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_jiusmzv1' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:57:30 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef317c5-a173-49f1-8035-3ed5c20e9691]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:30 devstack sudo[98311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD
Jul 06 20:57:30 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:30 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b 1G" returned: 0 in 0.848s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:30 devstack sudo[98314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b
Jul 06 20:57:30 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:31 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:31 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] 0acbb0cd-0336-492a-b73d-b152eae4e946 was qcow2, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 20:57:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:31 devstack sudo[98322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42
Jul 06 20:57:31 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:31 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b" returned: 0 in 0.692s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:31 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b is being set with open permissions: ugo+rw
Jul 06 20:57:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:31 devstack sudo[98324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b
Jul 06 20:57:31 devstack sudo[98324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:32 devstack sudo[98324]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b" returned: 0 in 0.675s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:32 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.info
Jul 06 20:57:32 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:32 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:32 devstack sudo[98340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.info
Jul 06 20:57:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.info" returned: 0 in 0.705s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:32 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.info is being set with open permissions: ugo+rw
Jul 06 20:57:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:32 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:33 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42" returned: 0 in 1.886s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_3g69mn6hdevstack@QuobyteHD, size 112.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:57:33 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Converted 112.00 MB image at 59.34 MB/s
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:33 devstack sudo[98342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 1G
Jul 06 20:57:33 devstack sudo[98342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:33 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.info" returned: 0 in 0.738s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.667s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:33 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-72ae8644-2910-4ac4-9b99-6c3b0709231e tempest-VolumesSnapshotTestJSON-1975442814 None] Create snapshot completed successfully
Jul 06 20:57:33 devstack sudo[98342]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 1G" returned: 0 in 0.688s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7dcdb7-0f7c-4ca2-8356-51194ba245c1]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:34 devstack sudo[98348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42
Jul 06 20:57:34 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:34 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42" returned: 0 in 0.756s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (aaed776d-5767-4319-80bb-09d15a5b710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:34 devstack sudo[98352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42
Jul 06 20:57:34 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffd193b-37c2-4839-9c23-8283ddc21cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffd193b-37c2-4839-9c23-8283ddc21cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1578270916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ceb34a95-3165-4a9b-8637-43cfbcb3489b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:35Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8afc4b6-0c71-47a8-b27e-148cfd256573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8afc4b6-0c71-47a8-b27e-148cfd256573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52558893-2f50-4b03-8cb0-517f3bd88eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52558893-2f50-4b03-8cb0-517f3bd88eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1', 'volume_name': 'volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1', 'volume_size': 2, 'snapshot_id': 'ceb34a95-3165-4a9b-8637-43cfbcb3489b'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6b9bc4-b3d0-43b4-a8e1-e9cb8493b3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d6b9bc4-b3d0-43b4-a8e1-e9cb8493b3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6800ed00-cd01-4a33-8e5c-0afc92784bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:34 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume 6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1', 'volume_size': 2, 'snapshot_id': 'ceb34a95-3165-4a9b-8637-43cfbcb3489b'}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-ceb34a95-3165-4a9b-8637-43cfbcb3489b-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-ceb34a95-3165-4a9b-8637-43cfbcb3489b-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating volume 6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 from snapshot ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] snapshot: ceb34a95-3165-4a9b-8637-43cfbcb3489b, volume: 6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d6b3f0-0522-44cb-a006-1b7a23831e1c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:35 devstack sudo[98354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b
Jul 06 20:57:35 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:35 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42" returned: 1 in 0.815s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Downloaded image 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume 1bcabf40-e6e4-4399-9ba2-e62905e36a42 successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 for user ee4e36e8e7104ff18c55c7435426c5dd is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Marking volume 1bcabf40-e6e4-4399-9ba2-e62905e36a42 as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Copying metadata from image 0acbb0cd-0336-492a-b73d-b152eae4e946 to 1bcabf40-e6e4-4399-9ba2-e62905e36a42. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Creating volume glance metadata for volume 1bcabf40-e6e4-4399-9ba2-e62905e36a42 backed by image 0acbb0cd-0336-492a-b73d-b152eae4e946 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fc8df7c-b2e2-4e14-8f3a-1c059adb11f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec1e2bd0>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed22ec-7c03-4f25-bcb6-4da2ab98b491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:35 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Volume volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 (1bcabf40-e6e4-4399-9ba2-e62905e36a42): created successfully
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60ed22ec-7c03-4f25-bcb6-4da2ab98b491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (767f90ca-4587-47da-a154-bf263afb1c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0039ac2f-8d47-4ceb-899c-a85fbde4c234 tempest-VolumesGetTest-959458932 None] Created volume successfully.
Jul 06 20:57:35 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[492ecb1c-c03e-40b9-b331-ca5e0d1b38f8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:35 devstack sudo[98362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41
Jul 06 20:57:35 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:36 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" returned: 0 in 0.818s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:36 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:57:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:36 devstack sudo[98368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1
Jul 06 20:57:36 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:36 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (faaf313b-4a72-44a8-9012-58e1de4a4ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7de319-c3bb-42cd-bdfb-25d1c3bd187d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa7de319-c3bb-42cd-bdfb-25d1c3bd187d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-95218009',display_name='tempest-VolumesGetTest-Volume-305308724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46283e81-dfc4-4035-83a0-8fb539943242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:37Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53ca4c2-9246-42dd-bb57-969527f0887f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53ca4c2-9246-42dd-bb57-969527f0887f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8acffc3-b08f-4c5f-a5ed-7cc78aada61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8acffc3-b08f-4c5f-a5ed-7cc78aada61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46283e81-dfc4-4035-83a0-8fb539943242', 'volume_name': 'volume-46283e81-dfc4-4035-83a0-8fb539943242', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f80c06-3411-4d16-959a-4915f869c375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43f80c06-3411-4d16-959a-4915f869c375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767dd3a3-177a-417a-9400-018ae27ea465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:37 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Volume 46283e81-dfc4-4035-83a0-8fb539943242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46283e81-dfc4-4035-83a0-8fb539943242', 'volume_size': 1}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:37 devstack sudo[98382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:37 devstack sudo[98382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:39 devstack sudo[98382]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.778s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:39 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:39 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:57:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:57:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Flow 'volume_create_manager' (84851576-ecaf-4e10-9dcc-7d7d0a6f22ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0989ffe2-1f2c-47de-b1f1-c84a985cd2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0989ffe2-1f2c-47de-b1f1-c84a985cd2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-433814570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d01bf9-0b21-4688-ad92-23d3f8f795c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134422d7b76942a28a0b0d9c71bd916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:42Z,use_quota=True,user_id='2ac875936e794b5486384bf72035a464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfaff04-7a30-4ee7-af62-aadf82a29d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:41 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cfaff04-7a30-4ee7-af62-aadf82a29d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10af6b4a-9c44-458a-86e8-40906a713d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10af6b4a-9c44-458a-86e8-40906a713d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d01bf9-0b21-4688-ad92-23d3f8f795c9', 'volume_name': 'volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d252cd80-5872-48ff-8457-702553099418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d252cd80-5872-48ff-8457-702553099418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a9e4b2-2041-49a7-9a58-5f24211485b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Volume 28d01bf9-0b21-4688-ad92-23d3f8f795c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9', 'volume_size': 1}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" returned: 0 in 5.374s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15176a6-2c42-4aea-a3c5-9cfbfc658d50]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:42 devstack sudo[98390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41
Jul 06 20:57:42 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:42 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" returned: 0 in 0.937s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:42 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41, size 1024.00 MB, duration 5.37 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:57:42 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Converted 1024.00 MB image at 190.53 MB/s
Jul 06 20:57:42 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 is being set with open permissions: ugo+rw
Jul 06 20:57:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:42 devstack sudo[98395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1
Jul 06 20:57:42 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:43 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" returned: 0 in 0.620s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" released by "_copy_volume_from_snapshot" :: held 8.655s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-ceb34a95-3165-4a9b-8637-43cfbcb3489b-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" released by "_create_volume_from_snapshot" :: held 8.689s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.706s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.479s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-95218009',display_name='tempest-VolumesGetTest-Volume-305308724',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46283e81-dfc4-4035-83a0-8fb539943242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a5cab6946e44d2862904715fb0d9b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:37Z,use_quota=True,user_id='ee4e36e8e7104ff18c55c7435426c5dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Creating volume 46283e81-dfc4-4035-83a0-8fb539943242 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:43 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:43 devstack sudo[98398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242 1073741824
Jul 06 20:57:43 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6800ed00-cd01-4a33-8e5c-0afc92784bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1', 'volume_size': 2, 'snapshot_id': 'ceb34a95-3165-4a9b-8637-43cfbcb3489b'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1aadc91-24e7-45cd-bb1d-57d2e69f7227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 (6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1): created successfully
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1aadc91-24e7-45cd-bb1d-57d2e69f7227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (aaed776d-5767-4319-80bb-09d15a5b710d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-631a528c-aaa6-4fc3-890e-a3180bfcd9b6 tempest-VolumesSnapshotTestJSON-1975442814 None] Created volume successfully.
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[225781f2-bc37-4eb7-a45b-5423d07be99c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:44 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1
Jul 06 20:57:44 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:44 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242 1073741824" returned: 0 in 0.894s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:44 devstack sudo[98405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242
Jul 06 20:57:44 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:44 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" returned: 0 in 0.839s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:44 devstack sudo[98410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1
Jul 06 20:57:44 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:45 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242" returned: 0 in 0.731s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-433814570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d01bf9-0b21-4688-ad92-23d3f8f795c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134422d7b76942a28a0b0d9c71bd916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:42Z,use_quota=True,user_id='2ac875936e794b5486384bf72035a464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Creating volume 28d01bf9-0b21-4688-ad92-23d3f8f795c9 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:45 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (767dd3a3-177a-417a-9400-018ae27ea465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46283e81-dfc4-4035-83a0-8fb539943242', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09345bf3-9956-47c7-abbf-295d026839ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:45 devstack sudo[98413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 1073741824
Jul 06 20:57:45 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Volume volume-46283e81-dfc4-4035-83a0-8fb539943242 (46283e81-dfc4-4035-83a0-8fb539943242): created successfully
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09345bf3-9956-47c7-abbf-295d026839ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Flow 'volume_create_manager' (faaf313b-4a72-44a8-9012-58e1de4a4ca6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-42f81487-eaca-4ee3-81da-75a136c1b70f tempest-VolumesGetTest-959458932 None] Created volume successfully.
Jul 06 20:57:45 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" returned: 0 in 0.689s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1" released by "delete_volume" :: held 1.569s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['341ff0bd-c8be-4883-8d10-8e88fdae22e4', 'ad81dd34-68da-47d3-8461-537c8a518477', '2e5b26f5-6424-4f0f-9ebf-dc2dfd6df902', '873da1ca-479b-43d9-a8db-d373c1566f70'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:45 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:45 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-46283e81-dfc4-4035-83a0-8fb539943242-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Lock "cinder-46283e81-dfc4-4035-83a0-8fb539943242-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-46283e81-dfc4-4035-83a0-8fb539943242" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-46283e81-dfc4-4035-83a0-8fb539943242" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8125c2ca-b8df-4119-bdf3-204dc07d57a0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-ceb34a95-3165-4a9b-8637-43cfbcb3489b-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-ceb34a95-3165-4a9b-8637-43cfbcb3489b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:46 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 1073741824" returned: 0 in 1.008s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-ceb34a95-3165-4a9b-8637-43cfbcb3489b" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:46 devstack sudo[98421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242
Jul 06 20:57:46 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-ceb34a95-3165-4a9b-8637-43cfbcb3489b" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleting offline snapshot ceb34a95-3165-4a9b-8637-43cfbcb3489b of volume 2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] snapshot_file for this snap is: volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[486f773f-910d-4df9-836a-9ac89b826be8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:46 devstack sudo[98424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9
Jul 06 20:57:46 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:46 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.762s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleted volume successfully.
Jul 06 20:57:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb8c4421-a1f7-4e66-b13a-a12c6e4a5143 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-6c60f0f5-73f4-4192-8f9c-5e55bef0cbc1-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:46 devstack sudo[98425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b
Jul 06 20:57:46 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:46 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242" returned: 0 in 0.903s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:47 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242
Jul 06 20:57:47 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:47 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9" returned: 0 in 0.753s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07a9e4b2-2041-49a7-9a58-5f24211485b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b713e4be-87b4-4ff0-a289-f27b16aa18a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:47 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Volume volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 (28d01bf9-0b21-4688-ad92-23d3f8f795c9): created successfully
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b713e4be-87b4-4ff0-a289-f27b16aa18a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Flow 'volume_create_manager' (84851576-ecaf-4e10-9dcc-7d7d0a6f22ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-65fba67d-b57b-489c-b565-c826fa412076 tempest-AttachVolumeNegativeTest-75244407 None] Created volume successfully.
Jul 06 20:57:47 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b" returned: 0 in 0.874s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee12235c-0917-4baa-8cac-19d2be3a18f0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:47 devstack sudo[98437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41
Jul 06 20:57:47 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:47 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-46283e81-dfc4-4035-83a0-8fb539943242" returned: 0 in 0.743s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-46283e81-dfc4-4035-83a0-8fb539943242" released by "delete_volume" :: held 1.699s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Created reservations ['d2dd5229-4cd2-43ba-97cc-dcd322d7de67', 'c32c631a-f7bd-4c88-8042-d4cadbc4ec3a', '7ddd2359-5868-4b3a-b7f1-0dc5df9b11f2', '7bb2527c-a8b5-41ac-bed2-4341bd19033e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:47 devstack sudo[98443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:47 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:48 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" returned: 0 in 0.757s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:48 devstack sudo[98446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b
Jul 06 20:57:48 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:48 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.692s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-1bcabf40-e6e4-4399-9ba2-e62905e36a42-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Deleted volume successfully.
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7237c60a-7970-48ca-a5a5-e33f48aa7374 tempest-VolumesGetTest-959458932 None] Lock "cinder-46283e81-dfc4-4035-83a0-8fb539943242-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Lock "cinder-1bcabf40-e6e4-4399-9ba2-e62905e36a42-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Acquiring lock "cinder-quobyte-1bcabf40-e6e4-4399-9ba2-e62905e36a42" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1bcabf40-e6e4-4399-9ba2-e62905e36a42" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[61dd8c4d-bdff-4336-8c10-b6dd55037539]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:48 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b" returned: 0 in 0.822s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:48 devstack sudo[98456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b
Jul 06 20:57:48 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:48 devstack sudo[98455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42
Jul 06 20:57:48 devstack sudo[98455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:49 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41.ceb34a95-3165-4a9b-8637-43cfbcb3489b" returned: 0 in 0.674s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:49 devstack sudo[98455]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42" returned: 0 in 0.760s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-ceb34a95-3165-4a9b-8637-43cfbcb3489b" released by "_delete_snapshot" :: held 3.252s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" released by "delete_snapshot" :: held 3.299s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:49 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['2bde8426-d3eb-4ee5-ad46-c68bc9d33c45', 'f056a9b5-276b-4827-83dd-65c30ada2283', '7c2fdfd9-8a83-4d15-9495-d56c2f55b14f', 'a142a781-f6b7-4406-961a-e0fc0a231905'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:49 devstack sudo[98462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42
Jul 06 20:57:49 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Delete snapshot completed successfully.
Jul 06 20:57:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-58059a17-93d4-4040-832e-1f590b8ef858 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-ceb34a95-3165-4a9b-8637-43cfbcb3489b-delete_snapshot" released by "delete_snapshot" :: held 3.471s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:50 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42" returned: 1 in 0.781s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:50 devstack sudo[98467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42
Jul 06 20:57:50 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fd7b5f-939a-4f95-9bfa-7885a8039252]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:50 devstack sudo[98469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41
Jul 06 20:57:50 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:51 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcabf40-e6e4-4399-9ba2-e62905e36a42" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Lock "cinder-quobyte-1bcabf40-e6e4-4399-9ba2-e62905e36a42" released by "delete_volume" :: held 2.333s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Created reservations ['922daaa9-9444-47a9-8800-87a9710b6136', 'ade3ebf1-9ee1-4fef-939d-5bf77e299110', 'a7996dd4-3279-4b7b-b4d0-29eb00135282', '7f8d756c-0320-43c7-917c-b6e2158ad431'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-84a3003b-194f-41ea-b52a-402ffc28de3d req-1ab6d3b8-c7a1-4d5b-8615-926cb51f39f2 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-84a3003b-194f-41ea-b52a-402ffc28de3d req-1ab6d3b8-c7a1-4d5b-8615-926cb51f39f2 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba39fa8a-6eea-49f8-bca8-7b61383ba5a8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:51 devstack sudo[98480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-84a3003b-194f-41ea-b52a-402ffc28de3d req-1ab6d3b8-c7a1-4d5b-8615-926cb51f39f2 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:51 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:51 devstack sudo[98482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9
Jul 06 20:57:51 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:51 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" returned: 0 in 0.891s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:51 devstack sudo[98487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41
Jul 06 20:57:51 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:51 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.698s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Deleted volume successfully.
Jul 06 20:57:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a17d4a75-1a06-4359-9a52-b0c4324e139d tempest-VolumesGetTest-959458932 None] Lock "cinder-1bcabf40-e6e4-4399-9ba2-e62905e36a42-delete_volume" released by "delete_volume" :: held 3.332s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:52 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-84a3003b-194f-41ea-b52a-402ffc28de3d req-1ab6d3b8-c7a1-4d5b-8615-926cb51f39f2 tempest-AttachVolumeNegativeTest-75244407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9" returned: 0 in 0.856s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-84a3003b-194f-41ea-b52a-402ffc28de3d req-1ab6d3b8-c7a1-4d5b-8615-926cb51f39f2 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-84a3003b-194f-41ea-b52a-402ffc28de3d req-1ab6d3b8-c7a1-4d5b-8615-926cb51f39f2 tempest-AttachVolumeNegativeTest-75244407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f37b6d2-f68e-4963-be2f-3ac425645164', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:57:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-84a3003b-194f-41ea-b52a-402ffc28de3d req-1ab6d3b8-c7a1-4d5b-8615-926cb51f39f2 tempest-AttachVolumeNegativeTest-75244407 None] attachment_update completed successfully.
Jul 06 20:57:52 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" returned: 0 in 0.779s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41" released by "delete_volume" :: held 1.731s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['acf3600b-6f57-4ea5-96de-a1ee46305e87', 'a7aabe4a-693e-405b-a667-517e59ea7179', 'fb5eac20-8e03-42bb-9954-7f17789a24d3', 'bb0803a8-bc9e-4be8-bae2-68b226509ad1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:52 devstack sudo[98494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:57:52 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:53 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.793s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:57:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleted volume successfully.
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0567ed64-2e4b-4698-a839-12cbf8fe2e34 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-2ed2ee1c-3c80-45c5-8923-8a5bf60bac41-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (8cfab5e0-4efb-4537-9723-e565242d8473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc7a012-311d-4cac-a28f-71a5a8fb7c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbc7a012-311d-4cac-a28f-71a5a8fb7c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2085409302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b403b8bc-992f-42cc-9afa-e2db320529cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:54Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311b613-9e3e-410a-9208-0685bbe3c3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e311b613-9e3e-410a-9208-0685bbe3c3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e865d185-0a4e-4882-8683-d594c76d72f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e865d185-0a4e-4882-8683-d594c76d72f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b403b8bc-992f-42cc-9afa-e2db320529cd', 'volume_name': 'volume-b403b8bc-992f-42cc-9afa-e2db320529cd', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9a1b37-70c0-4324-b781-fcd28d18ffc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9a1b37-70c0-4324-b781-fcd28d18ffc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf42645f-3d14-493a-9a82-cc0ee9e621ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Volume b403b8bc-992f-42cc-9afa-e2db320529cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b403b8bc-992f-42cc-9afa-e2db320529cd', 'volume_size': 1}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:57:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2085409302',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b403b8bc-992f-42cc-9afa-e2db320529cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:57:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:57:54Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Creating volume b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:57:53 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:57:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:53 devstack sudo[98880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd 1073741824
Jul 06 20:57:53 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:54 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd 1073741824" returned: 0 in 0.946s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:54 devstack sudo[98886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd
Jul 06 20:57:54 devstack sudo[98886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:55 devstack sudo[98886]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd" returned: 0 in 0.686s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf42645f-3d14-493a-9a82-cc0ee9e621ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b403b8bc-992f-42cc-9afa-e2db320529cd', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12845789-2f23-4449-911e-badd36c43bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:57:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Volume volume-b403b8bc-992f-42cc-9afa-e2db320529cd (b403b8bc-992f-42cc-9afa-e2db320529cd): created successfully
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12845789-2f23-4449-911e-badd36c43bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (8cfab5e0-4efb-4537-9723-e565242d8473) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:57:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-671e2a56-41af-4186-85f6-83ca243b3f7d tempest-VolumesSnapshotTestJSON-1975442814 None] Created volume successfully.
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating offline snapshot f013c634-22df-466c-9104-d422677d9814 of volume b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aec1fa-28a2-4826-b9af-7d457fbbe57c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:57:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:56 devstack sudo[98889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd
Jul 06 20:57:56 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:56 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd" returned: 0 in 0.886s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:56 devstack sudo[98895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 1G
Jul 06 20:57:56 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:57 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 1G" returned: 0 in 0.942s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403b8bc-992f-42cc-9afa-e2db320529cd -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:57 devstack sudo[98902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403b8bc-992f-42cc-9afa-e2db320529cd -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814
Jul 06 20:57:57 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:58 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b403b8bc-992f-42cc-9afa-e2db320529cd -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814" returned: 0 in 0.826s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:58 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 is being set with open permissions: ugo+rw
Jul 06 20:57:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:58 devstack sudo[98907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814
Jul 06 20:57:58 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:57:59 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root
Jul 06 20:57:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814" returned: 0 in 0.694s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:57:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-970c3f42-2f72-4fdb-b1bb-434fbf775586 req-e08a574f-b959-4df6-b5bd-e7f2a8603cc0 tempest-AttachVolumeNegativeTest-75244407 None] Terminate volume connection completed successfully.
Jul 06 20:57:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-970c3f42-2f72-4fdb-b1bb-434fbf775586 req-e08a574f-b959-4df6-b5bd-e7f2a8603cc0 tempest-AttachVolumeNegativeTest-75244407 None] Deleting attachment 6f37b6d2-f68e-4963-be2f-3ac425645164. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:57:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:57:59 devstack sudo[98937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.info
Jul 06 20:57:59 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:00 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.info" returned: 0 in 0.725s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:00 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.info is being set with open permissions: ugo+rw
Jul 06 20:58:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:00 devstack sudo[98940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.info
Jul 06 20:58:00 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:00 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.info" returned: 0 in 0.708s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.954s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a53d4c5c-83fa-42ca-8b83-07f9b0661293 tempest-VolumesSnapshotTestJSON-1975442814 None] Create snapshot completed successfully
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (bfdbbc8c-7675-4450-a4c5-b38db5b73dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2be1c6e-2437-42dc-8960-b4f863b23e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2be1c6e-2437-42dc-8960-b4f863b23e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1777822489',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae1d32c-b92d-4094-bd28-191000876391,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8275a04e33413c8d00417ab0a79b7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f013c634-22df-466c-9104-d422677d9814,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:02Z,use_quota=True,user_id='0df75ab694fb48919895a89b0fc19856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e93a7b-5156-4048-baea-d438cc9b8288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5e93a7b-5156-4048-baea-d438cc9b8288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a053e1dc-940c-416e-a0cc-4920b813716c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a053e1dc-940c-416e-a0cc-4920b813716c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ae1d32c-b92d-4094-bd28-191000876391', 'volume_name': 'volume-6ae1d32c-b92d-4094-bd28-191000876391', 'volume_size': 1, 'snapshot_id': 'f013c634-22df-466c-9104-d422677d9814'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b662eb-13dc-4bbb-a30d-dfbb7461802e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8b662eb-13dc-4bbb-a30d-dfbb7461802e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97b3334-51a4-417b-ab1a-dbca40984484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:01 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume 6ae1d32c-b92d-4094-bd28-191000876391: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ae1d32c-b92d-4094-bd28-191000876391', 'volume_size': 1, 'snapshot_id': 'f013c634-22df-466c-9104-d422677d9814'}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-f013c634-22df-466c-9104-d422677d9814-6ae1d32c-b92d-4094-bd28-191000876391" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-f013c634-22df-466c-9104-d422677d9814-6ae1d32c-b92d-4094-bd28-191000876391" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating volume 6ae1d32c-b92d-4094-bd28-191000876391 from snapshot f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-6ae1d32c-b92d-4094-bd28-191000876391" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6ae1d32c-b92d-4094-bd28-191000876391" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] snapshot: f013c634-22df-466c-9104-d422677d9814, volume: 6ae1d32c-b92d-4094-bd28-191000876391,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 20:58:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:02 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41a2d63-2ec4-4518-a3ee-589fc16dad4c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:02 devstack sudo[98943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814
Jul 06 20:58:02 devstack sudo[98943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:03 devstack sudo[98943]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814" returned: 0 in 0.980s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b403b8bc-992f-42cc-9afa-e2db320529cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 20:58:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 20:58:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b79a643-3bd0-4722-b3ae-c1e7e606ac71]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:03 devstack sudo[98954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd
Jul 06 20:58:03 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:04 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd" returned: 0 in 1.118s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:04 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 20:58:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:04 devstack sudo[98975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391
Jul 06 20:58:04 devstack sudo[98975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:10 devstack sudo[98975]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391" returned: 0 in 6.292s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96edb0f-482e-47ae-ba27-05c31e7cb9e1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:10 devstack sudo[99029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd
Jul 06 20:58:10 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:11 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd" returned: 0 in 1.181s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:11 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd, size 1024.00 MB, duration 6.29 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:58:11 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Converted 1024.00 MB image at 162.69 MB/s
Jul 06 20:58:11 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391 is being set with open permissions: ugo+rw
Jul 06 20:58:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:11 devstack sudo[99035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391
Jul 06 20:58:11 devstack sudo[99035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:11 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=66,cinder:INSERT=24,cinder:UPDATE=74,cinder:DELETE=7 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:58:11 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:INSERT=24,cinder:UPDATE=74,cinder:SELECT=74,cinder:DELETE=6 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:58:12 devstack sudo[99035]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391" returned: 0 in 0.989s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6ae1d32c-b92d-4094-bd28-191000876391" released by "_copy_volume_from_snapshot" :: held 10.688s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-f013c634-22df-466c-9104-d422677d9814-6ae1d32c-b92d-4094-bd28-191000876391" released by "_create_volume_from_snapshot" :: held 10.724s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.741s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b97b3334-51a4-417b-ab1a-dbca40984484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae1d32c-b92d-4094-bd28-191000876391', 'volume_size': 1, 'snapshot_id': 'f013c634-22df-466c-9104-d422677d9814'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2fe4e5-eebf-487b-84f6-0f78b8659c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Volume volume-6ae1d32c-b92d-4094-bd28-191000876391 (6ae1d32c-b92d-4094-bd28-191000876391): created successfully
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb2fe4e5-eebf-487b-84f6-0f78b8659c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Flow 'volume_create_manager' (bfdbbc8c-7675-4450-a4c5-b38db5b73dd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-636f19eb-3e00-48d0-acf4-62c3c885e322 tempest-VolumesSnapshotTestJSON-1975442814 None] Created volume successfully.
Jul 06 20:58:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-6ae1d32c-b92d-4094-bd28-191000876391-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-6ae1d32c-b92d-4094-bd28-191000876391-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-6ae1d32c-b92d-4094-bd28-191000876391" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6ae1d32c-b92d-4094-bd28-191000876391" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[015da3f0-74b2-45d9-93b1-edc4468ecfea]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:13 devstack sudo[99039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391
Jul 06 20:58:13 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:14 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391" returned: 0 in 0.907s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:14 devstack sudo[99044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391
Jul 06 20:58:14 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:14 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ae1d32c-b92d-4094-bd28-191000876391" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-6ae1d32c-b92d-4094-bd28-191000876391" released by "delete_volume" :: held 1.795s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:14 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['5856d6d2-1eb8-467f-8627-2277dcf2ac1a', 'cf54e212-9e82-4822-8c1c-af51e510d982', '0775db6c-9759-49f3-8d68-af2390eeda76', 'a1d3e221-b7c2-4eb8-98c7-9b2db53b0e92'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:15 devstack sudo[99050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:58:15 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-f013c634-22df-466c-9104-d422677d9814-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-f013c634-22df-466c-9104-d422677d9814-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-b403b8bc-992f-42cc-9afa-e2db320529cd" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-b403b8bc-992f-42cc-9afa-e2db320529cd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-f013c634-22df-466c-9104-d422677d9814" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-f013c634-22df-466c-9104-d422677d9814" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleting offline snapshot f013c634-22df-466c-9104-d422677d9814 of volume b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] snapshot_file for this snap is: volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e53678-7c1f-4e0b-ba78-12cbcdb38358]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:15 devstack sudo[99052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814
Jul 06 20:58:15 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:16 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.983s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:16 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:58:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleted volume successfully.
Jul 06 20:58:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c1c5c56-78b2-498e-8b58-f56e131fe886 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-6ae1d32c-b92d-4094-bd28-191000876391-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:16 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814" returned: 0 in 1.108s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b403b8bc-992f-42cc-9afa-e2db320529cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:16 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4647db-ea74-4873-b7b8-4b9b24348bbd]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:16 devstack sudo[99058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd
Jul 06 20:58:16 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:17 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd" returned: 0 in 0.884s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:17 devstack sudo[99063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814
Jul 06 20:58:17 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:18 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814" returned: 0 in 0.816s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:18 devstack sudo[99070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814
Jul 06 20:58:18 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:19 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd.f013c634-22df-466c-9104-d422677d9814" returned: 0 in 0.720s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-f013c634-22df-466c-9104-d422677d9814" released by "_delete_snapshot" :: held 3.652s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-b403b8bc-992f-42cc-9afa-e2db320529cd" released by "delete_snapshot" :: held 3.679s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['dc4d253e-26c4-42c3-bd59-82a460a17c39', 'f616dd5c-3ebf-42c1-a654-7ebbc0bffbdf', '263832f1-8f9d-484a-8c74-552973bc0f5a', 'de3a1df5-31ac-4841-8ab8-10915ad7e489'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:58:19 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Delete snapshot completed successfully.
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6304d8ae-5ca4-4c80-b25b-1cd467d626b7 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-f013c634-22df-466c-9104-d422677d9814-delete_snapshot" released by "delete_snapshot" :: held 3.847s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-b403b8bc-992f-42cc-9afa-e2db320529cd-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-b403b8bc-992f-42cc-9afa-e2db320529cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-b403b8bc-992f-42cc-9afa-e2db320529cd" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-b403b8bc-992f-42cc-9afa-e2db320529cd" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df7454f-fe57-4451-a655-53af632881ee]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:20 devstack sudo[99073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd
Jul 06 20:58:20 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:20 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd" returned: 0 in 0.977s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:20 devstack sudo[99078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd
Jul 06 20:58:20 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:21 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b403b8bc-992f-42cc-9afa-e2db320529cd" returned: 0 in 0.808s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-b403b8bc-992f-42cc-9afa-e2db320529cd" released by "delete_volume" :: held 1.905s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['ac0b1e3d-07a4-44dd-91fc-784b507f57b9', '39beb4ec-b4a1-4913-a19b-36c1a30eb61d', '63998ee2-b293-4512-a407-f947d85fb0f0', 'f18c543a-c23b-4c6f-ab0a-eddd0cbabbd2'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:22 devstack sudo[99099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:58:22 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-820063a5-1745-4eb2-bd5b-f518f54eaf7c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-820063a5-1745-4eb2-bd5b-f518f54eaf7c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "cinder-quobyte-820063a5-1745-4eb2-bd5b-f518f54eaf7c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-820063a5-1745-4eb2-bd5b-f518f54eaf7c" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[29556858-c2ab-4040-9059-77f19eddce13]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:22 devstack sudo[99104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c
Jul 06 20:58:22 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:22 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.012s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:22 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:58:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleted volume successfully.
Jul 06 20:58:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a55d78c0-7156-4547-a4e6-d31851b3e881 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-b403b8bc-992f-42cc-9afa-e2db320529cd-delete_volume" released by "delete_volume" :: held 3.244s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:23 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c" returned: 0 in 0.825s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:23 devstack sudo[99112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c
Jul 06 20:58:23 devstack sudo[99112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:23 devstack sudo[99112]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820063a5-1745-4eb2-bd5b-f518f54eaf7c" returned: 0 in 0.686s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-quobyte-820063a5-1745-4eb2-bd5b-f518f54eaf7c" released by "delete_volume" :: held 1.580s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Created reservations ['55432bad-1898-4d17-bf2c-1ddba7497723', '7c4c3702-bd80-40aa-957c-fdb9ad837c93', 'cf259236-19e4-4a01-945e-159f90f94530', '0b86fd1c-90c7-4c13-86da-5591161ac48a'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:24 devstack sudo[99115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:58:24 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:24 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.745s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:58:24 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Deleted volume successfully.
Jul 06 20:58:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-30c5036c-0016-4acb-9caa-51db6b262312 tempest-VolumesSnapshotTestJSON-1975442814 None] Lock "cinder-820063a5-1745-4eb2-bd5b-f518f54eaf7c-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Flow 'volume_create_manager' (7975764e-5448-4866-a0a8-619b9e3a3e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9b8897-a53b-4c5e-9933-bcee3b67ac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c9b8897-a53b-4c5e-9933-bcee3b67ac77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2045016307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68f2f64-b224-4f1b-81f8-b151cdefa56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd718490a644533a4467b111c9d906b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:27Z,use_quota=True,user_id='55bea0b0697846619bcb716bb9c68973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac3360-a8de-4dc0-a9fe-82d3c043feea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fac3360-a8de-4dc0-a9fe-82d3c043feea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafbdde4-a97f-4f03-a72b-f823097a5b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafbdde4-a97f-4f03-a72b-f823097a5b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd68f2f64-b224-4f1b-81f8-b151cdefa56c', 'volume_name': 'volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713debf53e60>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acdb857-3698-49d9-9218-9f225d1aa6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8acdb857-3698-49d9-9218-9f225d1aa6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93baea39-b8b8-41ad-ad92-f96614b6dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:27 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Volume d68f2f64-b224-4f1b-81f8-b151cdefa56c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713debf53e60>}
Jul 06 20:58:27 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Trying to clone d68f2f64-b224-4f1b-81f8-b151cdefa56c from image 0acbb0cd-0336-492a-b73d-b152eae4e946 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 20:58:28 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 20:58:28 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 20:58:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e07d14c-0885-4b40-9ce9-a15e5379d1e0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:28 devstack sudo[99186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD
Jul 06 20:58:28 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:29 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD" returned: 0 in 1.092s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:29 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 is fetched for user 55bea0b0697846619bcb716bb9c68973. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 20:58:29 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe01b31-99f6-4a2b-b8fb-605b35d564c5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:29 devstack sudo[99194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD
Jul 06 20:58:29 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:30 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD" returned: 0 in 0.902s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2045016307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d68f2f64-b224-4f1b-81f8-b151cdefa56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd718490a644533a4467b111c9d906b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:27Z,use_quota=True,user_id='55bea0b0697846619bcb716bb9c68973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Creating volume d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:58:30 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:58:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:30 devstack sudo[99200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c 1073741824
Jul 06 20:58:30 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:31 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c 1073741824" returned: 0 in 1.192s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:31 devstack sudo[99208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:58:31 devstack sudo[99208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:32 devstack sudo[99208]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 0 in 0.884s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] <== create_volume: return (2136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:58:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.144s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:32 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Attempting download of 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume d68f2f64-b224-4f1b-81f8-b151cdefa56c. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 20:58:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b311715-5380-456c-9d92-a956bcfa7a3b]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_ii2kew1a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:32 devstack sudo[99213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_ii2kew1a
Jul 06 20:58:32 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:33 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_ii2kew1a" returned: 0 in 0.882s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_ii2kew1a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Flow 'volume_create_manager' (33d39d46-dc2a-4f50-8ea9-de8072b4115a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0013f8-4d25-4c1f-80eb-95f44ecffddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed0013f8-4d25-4c1f-80eb-95f44ecffddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-567895339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af175710-4b53-461b-b0aa-7acc27076f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c400032974264b66916d2bbd427330e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:33Z,use_quota=True,user_id='bea422f802184ac4babaf723820acb2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e2710e-aa60-4542-8929-828113dce666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52e2710e-aa60-4542-8929-828113dce666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e778745-c1b6-4ac3-8d7c-b853fd5957ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:33 devstack sudo[99217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_ii2kew1a
Jul 06 20:58:33 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e778745-c1b6-4ac3-8d7c-b853fd5957ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af175710-4b53-461b-b0aa-7acc27076f9f', 'volume_name': 'volume-af175710-4b53-461b-b0aa-7acc27076f9f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2780569d-801c-40f0-b2b7-f7b0a1c70e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2780569d-801c-40f0-b2b7-f7b0a1c70e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353a91f6-dbc7-4b5d-832f-dcdd5f11efb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:33 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Volume af175710-4b53-461b-b0aa-7acc27076f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af175710-4b53-461b-b0aa-7acc27076f9f', 'volume_size': 1}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:58:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-567895339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af175710-4b53-461b-b0aa-7acc27076f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c400032974264b66916d2bbd427330e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:33Z,use_quota=True,user_id='bea422f802184ac4babaf723820acb2e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Creating volume af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:58:33 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:58:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:33 devstack sudo[99219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f 1073741824
Jul 06 20:58:33 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:34 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_ii2kew1a" returned: 1 in 0.856s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_ii2kew1a' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:58:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad720188-8c78-4124-82ef-5cc0a011f902]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:34 devstack sudo[99226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD
Jul 06 20:58:34 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:34 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f 1073741824" returned: 0 in 0.938s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:34 devstack sudo[99229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f
Jul 06 20:58:34 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:35 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD" returned: 0 in 0.802s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] 0acbb0cd-0336-492a-b73d-b152eae4e946 was qcow2, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:35 devstack sudo[99234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:58:35 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:35 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f" returned: 0 in 0.672s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353a91f6-dbc7-4b5d-832f-dcdd5f11efb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af175710-4b53-461b-b0aa-7acc27076f9f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da03298-f796-4df9-baf0-ac76dbb19649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:35 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Volume volume-af175710-4b53-461b-b0aa-7acc27076f9f (af175710-4b53-461b-b0aa-7acc27076f9f): created successfully
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8da03298-f796-4df9-baf0-ac76dbb19649) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Flow 'volume_create_manager' (33d39d46-dc2a-4f50-8ea9-de8072b4115a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-155b5e07-bc47-4380-a61a-38f3307857a9 tempest-VolumesSnapshotListTestJSON-1560970884 None] Created volume successfully.
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Creating offline snapshot 1195c401-2113-430a-9ee4-300d8fa27167 of volume af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f17d5c-a897-471c-9a59-b11f4bbd358d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:35 devstack sudo[99241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f
Jul 06 20:58:35 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:36 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f" returned: 0 in 0.919s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:36 devstack sudo[99250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 1G
Jul 06 20:58:36 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:37 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 0 in 1.958s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_lb0mx4yqdevstack@QuobyteHD, size 112.00 MB, duration 1.96 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 20:58:37 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Converted 112.00 MB image at 57.15 MB/s
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:37 devstack sudo[99252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c 1G
Jul 06 20:58:37 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:37 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 1G" returned: 0 in 0.888s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:37 devstack sudo[99257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:58:37 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:37 devstack sudo[99258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167
Jul 06 20:58:37 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:37 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c 1G" returned: 0 in 0.836s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a808347d-871b-421f-85c8-02c285a1f88f]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:38 devstack sudo[99265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:58:38 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:38 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:58:38 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167" returned: 0 in 0.869s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:38 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 is being set with open permissions: ugo+rw
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:38 devstack sudo[99271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167
Jul 06 20:58:38 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:38 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 0 in 0.879s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:38 devstack sudo[99276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:58:38 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:39 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167" returned: 0 in 0.679s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:39 devstack sudo[99279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.info
Jul 06 20:58:39 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:39 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 1 in 0.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Downloaded image 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume d68f2f64-b224-4f1b-81f8-b151cdefa56c successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 for user 55bea0b0697846619bcb716bb9c68973 is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Marking volume d68f2f64-b224-4f1b-81f8-b151cdefa56c as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Copying metadata from image 0acbb0cd-0336-492a-b73d-b152eae4e946 to d68f2f64-b224-4f1b-81f8-b151cdefa56c. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Creating volume glance metadata for volume d68f2f64-b224-4f1b-81f8-b151cdefa56c backed by image 0acbb0cd-0336-492a-b73d-b152eae4e946 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93baea39-b8b8-41ad-ad92-f96614b6dd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713debf53e60>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e045f1d9-e8d1-43c9-a690-a851b7e69a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:39 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Volume volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c (d68f2f64-b224-4f1b-81f8-b151cdefa56c): created successfully
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e045f1d9-e8d1-43c9-a690-a851b7e69a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Flow 'volume_create_manager' (7975764e-5448-4866-a0a8-619b9e3a3e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:39 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-844fc861-7ffe-47f7-8915-23dde1c97f9b tempest-TestShelveInstance-1958325446 None] Created volume successfully.
Jul 06 20:58:39 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.info" returned: 0 in 0.750s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:39 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.info is being set with open permissions: ugo+rw
Jul 06 20:58:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:40 devstack sudo[99285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.info
Jul 06 20:58:40 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:40 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.info" returned: 0 in 0.750s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.981s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4055fb27-3491-4f21-8ce5-e18b11dfc1cf tempest-VolumesSnapshotListTestJSON-1560970884 None] Create snapshot completed successfully
Jul 06 20:58:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Creating offline snapshot c44ba19d-d0bf-40c0-90b4-da396e10d6bc of volume af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:58:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea129fb-619c-4cb2-adc9-2ffd98616ada]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:41 devstack sudo[99310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167
Jul 06 20:58:41 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:42 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167" returned: 0 in 0.851s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af175710-4b53-461b-b0aa-7acc27076f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:42 devstack sudo[99318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc 1G
Jul 06 20:58:42 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:43 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc 1G" returned: 0 in 0.923s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:43 devstack sudo[99324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc
Jul 06 20:58:43 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:43 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc" returned: 0 in 0.744s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:43 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc is being set with open permissions: ugo+rw
Jul 06 20:58:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:43 devstack sudo[99329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc
Jul 06 20:58:43 devstack sudo[99329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:44 devstack sudo[99329]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc" returned: 0 in 0.668s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.286s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:44 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-857c8289-c55d-425b-9ab3-fd0101b61f8c tempest-VolumesSnapshotListTestJSON-1560970884 None] Create snapshot completed successfully
Jul 06 20:58:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Creating offline snapshot a57a24f2-c14a-465b-9c4d-e97b4015bba9 of volume af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:58:45 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e296bec9-bd0b-41b4-897b-564026795273]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:45 devstack sudo[99332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc
Jul 06 20:58:45 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:46 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc" returned: 0 in 0.829s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af175710-4b53-461b-b0aa-7acc27076f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:46 devstack sudo[99337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 1G
Jul 06 20:58:46 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:47 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 1G" returned: 0 in 1.044s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:47 devstack sudo[99343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9
Jul 06 20:58:47 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:48 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9" returned: 0 in 0.856s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:48 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 is being set with open permissions: ugo+rw
Jul 06 20:58:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:48 devstack sudo[99358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9
Jul 06 20:58:48 devstack sudo[99358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:49 devstack sudo[99358]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9" returned: 0 in 0.704s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.539s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.116s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-408aaade-4c41-4d5e-b898-19dfd94a6581 tempest-VolumesSnapshotListTestJSON-1560970884 None] Create snapshot completed successfully
Jul 06 20:58:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6249f680-69d6-488c-ab73-d9c59911dd52]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:49 devstack sudo[99361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:58:49 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:49 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 0 in 0.799s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:50 devstack sudo[99365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:58:50 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-a57a24f2-c14a-465b-9c4d-e97b4015bba9-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-a57a24f2-c14a-465b-9c4d-e97b4015bba9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-quobyte-a57a24f2-c14a-465b-9c4d-e97b4015bba9" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-a57a24f2-c14a-465b-9c4d-e97b4015bba9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Deleting offline snapshot a57a24f2-c14a-465b-9c4d-e97b4015bba9 of volume af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] snapshot_file for this snap is: volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cb0901-1ed2-4edb-8e9b-3107d2677875]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:50 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 1 in 0.819s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.663s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:50 devstack sudo[99370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9
Jul 06 20:58:50 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d1c548b-2dd1-4132-8a83-f2c9c00d7063', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:58:50 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-c87b4b1b-d900-44c1-98d8-3791f4152026 req-965c8e19-bc68-4b53-9b9e-6192900adea5 tempest-TestShelveInstance-1958325446 None] attachment_update completed successfully.
Jul 06 20:58:51 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9" returned: 0 in 0.787s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af175710-4b53-461b-b0aa-7acc27076f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c7570b-f4f9-4ae9-85fa-516c09654df8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:51 devstack sudo[99375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc
Jul 06 20:58:51 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:52 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc" returned: 0 in 0.786s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af175710-4b53-461b-b0aa-7acc27076f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:52 devstack sudo[99382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9
Jul 06 20:58:52 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:52 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:58:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Flow 'volume_create_manager' (8637da62-b038-416b-a7b3-ccde1644cf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f898d58-7635-4f97-9dd7-5ce81e09d8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f898d58-7635-4f97-9dd7-5ce81e09d8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1841923174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1756fa6-4788-4db0-b9ed-a77acbf53081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134422d7b76942a28a0b0d9c71bd916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:53Z,use_quota=True,user_id='2ac875936e794b5486384bf72035a464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d900cc-3b91-4670-998d-4d6f09898c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81d900cc-3b91-4670-998d-4d6f09898c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163dc18f-6245-4c2d-bb03-a76077f38997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (163dc18f-6245-4c2d-bb03-a76077f38997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1756fa6-4788-4db0-b9ed-a77acbf53081', 'volume_name': 'volume-f1756fa6-4788-4db0-b9ed-a77acbf53081', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998a16c8-5df9-4e27-b6ad-81c37676f133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998a16c8-5df9-4e27-b6ad-81c37676f133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a26b98-8955-4d8c-9944-d4bc16c40a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Volume f1756fa6-4788-4db0-b9ed-a77acbf53081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1756fa6-4788-4db0-b9ed-a77acbf53081', 'volume_size': 1}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:58:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1841923174',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1756fa6-4788-4db0-b9ed-a77acbf53081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134422d7b76942a28a0b0d9c71bd916f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:58:53Z,use_quota=True,user_id='2ac875936e794b5486384bf72035a464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Creating volume f1756fa6-4788-4db0-b9ed-a77acbf53081 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:58:53 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:53 devstack sudo[99455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 1073741824
Jul 06 20:58:53 devstack sudo[99455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:53 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9" returned: 0 in 0.952s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:53 devstack sudo[99457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9
Jul 06 20:58:53 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:53 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.a57a24f2-c14a-465b-9c4d-e97b4015bba9" returned: 0 in 0.674s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-a57a24f2-c14a-465b-9c4d-e97b4015bba9" released by "_delete_snapshot" :: held 3.319s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" released by "delete_snapshot" :: held 3.348s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 1073741824" returned: 0 in 0.932s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:53 devstack sudo[99455]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:54 devstack sudo[99477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081
Jul 06 20:58:54 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Created reservations ['b22d697d-8983-43a4-9509-10dcea313cb3', '77cdb5b7-aa35-4aa5-9ecc-e781eb8a0df9', '4c8afa9b-dbde-4a13-934d-89d2164568a0', '19355669-2be6-46b3-b747-b21134a7167d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:58:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Delete snapshot completed successfully.
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-820dc118-35af-4cf1-bfbe-66cdf20988ba tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-a57a24f2-c14a-465b-9c4d-e97b4015bba9-delete_snapshot" released by "delete_snapshot" :: held 3.725s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-c44ba19d-d0bf-40c0-90b4-da396e10d6bc-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-c44ba19d-d0bf-40c0-90b4-da396e10d6bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-quobyte-c44ba19d-d0bf-40c0-90b4-da396e10d6bc" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-c44ba19d-d0bf-40c0-90b4-da396e10d6bc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Deleting offline snapshot c44ba19d-d0bf-40c0-90b4-da396e10d6bc of volume af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] snapshot_file for this snap is: volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6db2806-0131-4fdd-b8f4-6df0b4e26c99]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:54 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081" returned: 0 in 0.882s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:58:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a26b98-8955-4d8c-9944-d4bc16c40a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1756fa6-4788-4db0-b9ed-a77acbf53081', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f896b98-37a8-4f11-81f1-ed114876364b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:58:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Volume volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 (f1756fa6-4788-4db0-b9ed-a77acbf53081): created successfully
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f896b98-37a8-4f11-81f1-ed114876364b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Flow 'volume_create_manager' (8637da62-b038-416b-a7b3-ccde1644cf06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:58:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-670e98ad-3d5f-41a0-8509-2b589e646524 tempest-AttachVolumeNegativeTest-75244407 None] Created volume successfully.
Jul 06 20:58:55 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc
Jul 06 20:58:55 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:55 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc" returned: 0 in 0.826s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af175710-4b53-461b-b0aa-7acc27076f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c38696e-c2a4-4182-af85-165e6fc864ea]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:55 devstack sudo[99843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167
Jul 06 20:58:55 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:56 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167" returned: 0 in 0.840s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af175710-4b53-461b-b0aa-7acc27076f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:58:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:56 devstack sudo[99858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc
Jul 06 20:58:56 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:57 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc" returned: 0 in 0.907s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:57 devstack sudo[99865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc
Jul 06 20:58:57 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:58 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root
Jul 06 20:58:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.c44ba19d-d0bf-40c0-90b4-da396e10d6bc" returned: 0 in 0.696s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:58:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-c44ba19d-d0bf-40c0-90b4-da396e10d6bc" released by "_delete_snapshot" :: held 3.408s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" released by "delete_snapshot" :: held 3.442s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:58 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Created reservations ['ffbda617-9669-4e0a-8430-148621e51052', '87d94b44-3a92-4911-ae48-7c9dd4074c6c', '50da160a-4408-49f1-abaa-c5a067009cb2', '819c04a7-54e9-4fca-9c2c-e757b79c111e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:58:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Delete snapshot completed successfully.
Jul 06 20:58:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-231216b9-ac12-4c54-bf1f-bd895ca71a13 tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-c44ba19d-d0bf-40c0-90b4-da396e10d6bc-delete_snapshot" released by "delete_snapshot" :: held 3.652s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-1195c401-2113-430a-9ee4-300d8fa27167-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-1195c401-2113-430a-9ee4-300d8fa27167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-quobyte-1195c401-2113-430a-9ee4-300d8fa27167" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-1195c401-2113-430a-9ee4-300d8fa27167" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Deleting offline snapshot 1195c401-2113-430a-9ee4-300d8fa27167 of volume af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] snapshot_file for this snap is: volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3b9f3-a809-4a9d-8253-30bbaba1c5c1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:59 devstack sudo[99876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167
Jul 06 20:58:59 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-82a6850d-b1f7-45d6-896d-88f08aefd4d3 req-eea70fa4-1ebc-4f47-b938-8b57abf6d5f3 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-82a6850d-b1f7-45d6-896d-88f08aefd4d3 req-eea70fa4-1ebc-4f47-b938-8b57abf6d5f3 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[16401a71-7b0c-419f-b40c-9493a8b2bf65]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:58:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-82a6850d-b1f7-45d6-896d-88f08aefd4d3 req-eea70fa4-1ebc-4f47-b938-8b57abf6d5f3 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:58:59 devstack sudo[99879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081
Jul 06 20:58:59 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:00 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167" returned: 0 in 0.929s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af175710-4b53-461b-b0aa-7acc27076f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:59:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9a7075-fde5-4af5-8d6b-44549ddcaffb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:00 devstack sudo[99884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f
Jul 06 20:59:00 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:00 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-82a6850d-b1f7-45d6-896d-88f08aefd4d3 req-eea70fa4-1ebc-4f47-b938-8b57abf6d5f3 tempest-AttachVolumeNegativeTest-75244407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081" returned: 0 in 1.188s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-82a6850d-b1f7-45d6-896d-88f08aefd4d3 req-eea70fa4-1ebc-4f47-b938-8b57abf6d5f3 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.212s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-82a6850d-b1f7-45d6-896d-88f08aefd4d3 req-eea70fa4-1ebc-4f47-b938-8b57abf6d5f3 tempest-AttachVolumeNegativeTest-75244407 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-f1756fa6-4788-4db0-b9ed-a77acbf53081', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69a228bd-117c-474b-97cb-cf76c1e4b108', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:59:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-82a6850d-b1f7-45d6-896d-88f08aefd4d3 req-eea70fa4-1ebc-4f47-b938-8b57abf6d5f3 tempest-AttachVolumeNegativeTest-75244407 None] attachment_update completed successfully.
Jul 06 20:59:01 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f" returned: 0 in 1.180s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:01 devstack sudo[99892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167
Jul 06 20:59:01 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:02 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167" returned: 0 in 1.081s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:02 devstack sudo[99903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167
Jul 06 20:59:02 devstack sudo[99903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:03 devstack sudo[99903]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f.1195c401-2113-430a-9ee4-300d8fa27167" returned: 0 in 0.684s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-1195c401-2113-430a-9ee4-300d8fa27167" released by "_delete_snapshot" :: held 4.077s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" released by "delete_snapshot" :: held 4.120s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:03 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Created reservations ['6465cedd-2a1c-42db-a58a-0b87f4b1935e', 'b12aa18a-fe79-4aac-bf44-a2b42099596f', '977446bc-b2e0-439d-9505-579e129d6188', '6764de10-1080-4585-aa2d-4c959d08a394'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Delete snapshot completed successfully.
Jul 06 20:59:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8c1e6051-bffc-4d7a-a8c8-d402caf627ee tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-1195c401-2113-430a-9ee4-300d8fa27167-delete_snapshot" released by "delete_snapshot" :: held 4.298s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-af175710-4b53-461b-b0aa-7acc27076f9f-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-af175710-4b53-461b-b0aa-7acc27076f9f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec62f40a-a2f5-41f3-8e06-e0d44871152f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:04 devstack sudo[99906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f
Jul 06 20:59:04 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:05 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f" returned: 0 in 0.856s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:05 devstack sudo[99911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f
Jul 06 20:59:05 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:06 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-af175710-4b53-461b-b0aa-7acc27076f9f" returned: 0 in 0.757s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-quobyte-af175710-4b53-461b-b0aa-7acc27076f9f" released by "delete_volume" :: held 1.670s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Created reservations ['56c30f41-02ac-4343-8b67-b0ec8ebb173b', '6b221186-c4e6-42a8-9b33-f4273a987ce6', '580d811d-0d7b-4526-b6f1-5e3088494f48', '8788705e-ec00-4fc3-b834-b32961807dbe'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:06 devstack sudo[99914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:59:06 devstack sudo[99914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:07 devstack sudo[99914]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.765s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:07 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:59:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Deleted volume successfully.
Jul 06 20:59:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-50c3094b-5098-43cb-a36f-5c0c591b318d tempest-VolumesSnapshotListTestJSON-1560970884 None] Lock "cinder-af175710-4b53-461b-b0aa-7acc27076f9f-delete_volume" released by "delete_volume" :: held 2.678s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-b4b68170-9ba0-4684-b69e-4d83d5af52f6 req-c041f659-2a3b-415e-9227-bac2a6b1235f tempest-AttachVolumeNegativeTest-75244407 None] Terminate volume connection completed successfully.
Jul 06 20:59:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-b4b68170-9ba0-4684-b69e-4d83d5af52f6 req-c041f659-2a3b-415e-9227-bac2a6b1235f tempest-AttachVolumeNegativeTest-75244407 None] Deleting attachment 69a228bd-117c-474b-97cb-cf76c1e4b108. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Flow 'volume_create_manager' (c96abda2-b03a-44c0-a3b7-82d4d089e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f28bfca-9078-4965-bdb4-dc2a66ee1bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f28bfca-9078-4965-bdb4-dc2a66ee1bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1889115166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ba62a8-a2ba-478a-8f91-d5f9e08ec400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408672d25d064ff29922351db20e465d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:10Z,use_quota=True,user_id='8ce2c0aadf8c4caba234c9d0cc8a0e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8959bf-953b-4de0-b64a-36f19e51b9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e8959bf-953b-4de0-b64a-36f19e51b9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76cb91b-54ff-49c4-9556-4c9f3448b6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a76cb91b-54ff-49c4-9556-4c9f3448b6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ba62a8-a2ba-478a-8f91-d5f9e08ec400', 'volume_name': 'volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400', 'volume_size': 2}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87a0ebc-07fd-4f84-8c15-dbd3513abf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87a0ebc-07fd-4f84-8c15-dbd3513abf4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16117c3-9320-4020-8e37-8daeaa717fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:10 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Volume a7ba62a8-a2ba-478a-8f91-d5f9e08ec400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400', 'volume_size': 2}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1889115166',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ba62a8-a2ba-478a-8f91-d5f9e08ec400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408672d25d064ff29922351db20e465d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:10Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:10Z,use_quota=True,user_id='8ce2c0aadf8c4caba234c9d0cc8a0e32',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Creating volume a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:59:10 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:59:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 2147483648 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:10 devstack sudo[99957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 2147483648
Jul 06 20:59:10 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:11 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 2147483648" returned: 0 in 1.239s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:11 devstack sudo[100064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400
Jul 06 20:59:11 devstack sudo[100064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:12 devstack sudo[100064]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" returned: 0 in 0.920s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] <== create_volume: return (2236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=81,cinder:UPDATE=74,cinder:DELETE=6,cinder:INSERT=30 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a16117c3-9320-4020-8e37-8daeaa717fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400', 'volume_size': 2}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74392dc8-9862-4040-80a2-28977dcd49bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=77,cinder:SELECT=73,cinder:INSERT=20,cinder:DELETE=5 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:59:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Volume volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 (a7ba62a8-a2ba-478a-8f91-d5f9e08ec400): created successfully
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74392dc8-9862-4040-80a2-28977dcd49bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Flow 'volume_create_manager' (c96abda2-b03a-44c0-a3b7-82d4d089e107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-be024b8d-599a-41fe-b430-eaf2fd659549 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Created volume successfully.
Jul 06 20:59:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Creating offline snapshot 01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 of volume a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 20:59:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace81e6-4476-4d5e-a463-42fdf0133980]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:13 devstack sudo[100098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400
Jul 06 20:59:13 devstack sudo[100098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:14 devstack sudo[100098]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" returned: 0 in 0.760s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 2G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:14 devstack sudo[100103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 2G
Jul 06 20:59:14 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:15 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 2G" returned: 0 in 0.802s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:15 devstack sudo[100108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4
Jul 06 20:59:15 devstack sudo[100108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:15 devstack sudo[100108]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" returned: 0 in 0.707s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:15 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 is being set with open permissions: ugo+rw
Jul 06 20:59:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:16 devstack sudo[100113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4
Jul 06 20:59:16 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:16 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" returned: 0 in 0.675s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:16 devstack sudo[100116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.info
Jul 06 20:59:16 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:17 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.info" returned: 0 in 0.695s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:17 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.info is being set with open permissions: ugo+rw
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:17 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.info
Jul 06 20:59:17 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "cinder-f1756fa6-4788-4db0-b9ed-a77acbf53081-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-f1756fa6-4788-4db0-b9ed-a77acbf53081-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "cinder-quobyte-f1756fa6-4788-4db0-b9ed-a77acbf53081" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-quobyte-f1756fa6-4788-4db0-b9ed-a77acbf53081" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c7d6ed-323d-402b-9c4a-51e50cc8f738]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:18 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.info" returned: 0 in 0.647s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.381s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9e401950-dc30-4673-9ce8-9be1d2434606 tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Create snapshot completed successfully
Jul 06 20:59:18 devstack sudo[100123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081
Jul 06 20:59:18 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:18 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081" returned: 0 in 0.777s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:18 devstack sudo[100128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081
Jul 06 20:59:18 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "cinder-01f9947a-baa5-4ca5-9a4f-c53ac3e022e4-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-01f9947a-baa5-4ca5-9a4f-c53ac3e022e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "cinder-quobyte-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-quobyte-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "cinder-quobyte-01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-quobyte-01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Deleting offline snapshot 01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 of volume a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] snapshot_file for this snap is: volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b968ec-336c-41e2-af39-bd8961d010b8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:19 devstack sudo[100130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4
Jul 06 20:59:19 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:19 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f1756fa6-4788-4db0-b9ed-a77acbf53081" returned: 0 in 0.741s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-quobyte-f1756fa6-4788-4db0-b9ed-a77acbf53081" released by "delete_volume" :: held 1.569s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Created reservations ['d3083399-6223-4014-ad80-e03e3e715722', '0e2db883-b26b-42de-85ee-beba0ed14d61', '46d40155-eadc-46e7-88e5-d234253694d7', '9d1677ff-9eda-4bd3-a024-204490e6b534'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:19 devstack sudo[100133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:59:19 devstack sudo[100133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:20 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" returned: 0 in 0.905s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[698c035c-de06-4f6a-9b87-3e9c6ecb7f68]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "cinder-28d01bf9-0b21-4688-ad92-23d3f8f795c9-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-28d01bf9-0b21-4688-ad92-23d3f8f795c9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:20 devstack sudo[100138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400
Jul 06 20:59:20 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "cinder-quobyte-28d01bf9-0b21-4688-ad92-23d3f8f795c9" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-quobyte-28d01bf9-0b21-4688-ad92-23d3f8f795c9" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e155f-2675-4706-afb0-a4be805c42e8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:20 devstack sudo[100133]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.768s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:59:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Deleted volume successfully.
Jul 06 20:59:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9cfb9f98-3518-43f4-b479-fef448cee06e tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-f1756fa6-4788-4db0-b9ed-a77acbf53081-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:20 devstack sudo[100141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9
Jul 06 20:59:20 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:21 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" returned: 0 in 0.909s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:21 devstack sudo[100146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4
Jul 06 20:59:21 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:21 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9" returned: 0 in 0.968s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:21 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9
Jul 06 20:59:21 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:21 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" returned: 0 in 0.806s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:21 devstack sudo[100162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4
Jul 06 20:59:21 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:22 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-28d01bf9-0b21-4688-ad92-23d3f8f795c9" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-quobyte-28d01bf9-0b21-4688-ad92-23d3f8f795c9" released by "delete_volume" :: held 1.739s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Created reservations ['7903e70e-e00b-43f0-acf5-fca9a37bbb44', '8cf732c2-56c7-4717-82ce-2797ab6c23d8', 'cff20dd8-0802-4dd0-a019-b887dcd5f602', 'd475973d-108e-4f25-9879-bff0cf489531'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:22 devstack sudo[100171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:59:22 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:22 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400.01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" returned: 0 in 0.668s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-quobyte-01f9947a-baa5-4ca5-9a4f-c53ac3e022e4" released by "_delete_snapshot" :: held 3.481s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-quobyte-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" released by "delete_snapshot" :: held 3.517s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Created reservations ['2496e801-2361-4427-a04b-f6c376ce2606', 'd4812223-cc88-401b-8837-193a75c3f0e1', 'e05d1d41-8086-491c-9bad-eac30891958c', '7dae6eab-3f7d-4715-a855-0b7872c7ee7d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "cinder-ea2ab911-a1fe-4529-8cc7-dc84aa92a187-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:22 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Delete snapshot completed successfully.
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e8a356a0-8faa-431a-bbc8-2bc3d7a68bec tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-01f9947a-baa5-4ca5-9a4f-c53ac3e022e4-delete_snapshot" released by "delete_snapshot" :: held 3.734s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-ea2ab911-a1fe-4529-8cc7-dc84aa92a187-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "cinder-quobyte-ea2ab911-a1fe-4529-8cc7-dc84aa92a187" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-quobyte-ea2ab911-a1fe-4529-8cc7-dc84aa92a187" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bb47c9-3a8f-42cd-8645-4ff8f8d8e184]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:23 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.748s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:59:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Deleted volume successfully.
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8a1554c3-ca68-48ae-bdf0-ccb06b000e63 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-28d01bf9-0b21-4688-ad92-23d3f8f795c9-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:23 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187
Jul 06 20:59:23 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "cinder-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "cinder-quobyte-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-quobyte-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d27d54-d947-4e09-97e3-a1a8e72a573b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:23 devstack sudo[100177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400
Jul 06 20:59:23 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:23 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187" returned: 0 in 0.771s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:23 devstack sudo[100182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187
Jul 06 20:59:23 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:24 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" returned: 0 in 0.848s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:24 devstack sudo[100192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400
Jul 06 20:59:24 devstack sudo[100192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:24 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ea2ab911-a1fe-4529-8cc7-dc84aa92a187" returned: 0 in 0.698s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-quobyte-ea2ab911-a1fe-4529-8cc7-dc84aa92a187" released by "delete_volume" :: held 1.524s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Created reservations ['d83e00cc-73be-4f1e-9e4a-7e0f05fad6f5', '7b5c53b2-8acd-4a0d-9fc4-0a0784b14ce3', 'e1a4a2e3-d2d0-41fa-8236-53b955ec5270', 'c207ad43-282f-440b-8b78-8421c22dd41d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:24 devstack sudo[100194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:59:24 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:25 devstack sudo[100192]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" returned: 0 in 0.713s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-quobyte-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400" released by "delete_volume" :: held 1.628s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Created reservations ['08f3590c-7679-43d8-865b-dff3aa74d428', '911c229b-17fc-469f-aed3-0891715f523d', '1047231a-0383-48fd-a66d-7d08661467b5', 'e7f55236-afb4-4240-ae5b-dc3797450e1c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:25 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:59:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Deleted volume successfully.
Jul 06 20:59:25 devstack sudo[100198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:59:25 devstack sudo[100198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a3655d0d-2a06-45d1-8d8f-036ba76aac93 tempest-AttachVolumeNegativeTest-75244407 None] Lock "cinder-ea2ab911-a1fe-4529-8cc7-dc84aa92a187-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:26 devstack sudo[100198]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.810s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:26 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:59:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Deleted volume successfully.
Jul 06 20:59:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c1bfcd6b-7bdc-41f5-97f8-659c5ddf306f tempest-VolumesSnapshotNegativeTestJSON-392389501 None] Lock "cinder-a7ba62a8-a2ba-478a-8f91-d5f9e08ec400-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:29 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-b55fdcc2-dccc-44b6-835e-78641be00576 req-c1a18394-9068-41a8-bcd8-5d99bf971c16 tempest-TestShelveInstance-1958325446 None] Terminate volume connection completed successfully.
Jul 06 20:59:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-b55fdcc2-dccc-44b6-835e-78641be00576 req-c1a18394-9068-41a8-bcd8-5d99bf971c16 tempest-TestShelveInstance-1958325446 None] Deleting attachment 9d1c548b-2dd1-4132-8a83-f2c9c00d7063. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 20:59:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c7f19f33-13bf-4434-82ed-cf478bbc859b tempest-BackendsCapabilitiesAdminTestsJSON-1599020680 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86721) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 20:59:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1f2b815a-c802-4e24-b48f-4437f49c9d1e tempest-BackendsCapabilitiesAdminTestsJSON-1599020680 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86721) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 20:59:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9a6efa-788b-4b8a-ba76-51d57eda2456]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:35 devstack sudo[100233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:59:35 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:36 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 0 in 0.984s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:36 devstack sudo[100237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 20:59:36 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:37 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 1 in 0.895s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.937s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:37 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:59:37 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '53eabec1-f9fc-4477-983b-cc1e38ed1caf', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 20:59:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-f8c967b6-88c2-4a3f-996b-0e5cc88d26df req-ae81877b-d99a-4804-8318-6c5e87eb4bae tempest-TestShelveInstance-1958325446 None] attachment_update completed successfully.
Jul 06 20:59:38 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.799s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:59:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 20:59:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 20:59:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 20:59:47 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=41,cinder:DELETE=3,cinder:SELECT=30,cinder:INSERT=10 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:59:47 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=41,cinder:UPDATE=41,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Flow 'volume_create_manager' (489e958e-9118-457a-a7ad-5435c7c5600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f2456e-44c0-4001-b7aa-eeee62c3c1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f2456e-44c0-4001-b7aa-eeee62c3c1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-581912001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e576f07a-19ff-420b-b4f0-68111d1f2bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11af1ab61ca14c6080b1af4a363fec67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:53Z,use_quota=True,user_id='094a91d391f5407a9930d3ec5627b747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8474d47f-fd43-44d1-bd09-b7d124d41bac),volume_type_id=8474d47f-fd43-44d1-bd09-b7d124d41bac)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbc982d-5d9e-4114-b3a5-2f7e9fd48f36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbc982d-5d9e-4114-b3a5-2f7e9fd48f36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196473e-291c-4914-92f9-152d4db1ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8196473e-291c-4914-92f9-152d4db1ede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e576f07a-19ff-420b-b4f0-68111d1f2bc2', 'volume_name': 'volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090a77de-5ff8-4d8d-8ffc-ddac12c669df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090a77de-5ff8-4d8d-8ffc-ddac12c669df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd46e9d-5284-4475-8d37-3b95b9d31956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Volume e576f07a-19ff-420b-b4f0-68111d1f2bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2', 'volume_size': 1}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-581912001',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e576f07a-19ff-420b-b4f0-68111d1f2bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11af1ab61ca14c6080b1af4a363fec67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:53Z,use_quota=True,user_id='094a91d391f5407a9930d3ec5627b747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8474d47f-fd43-44d1-bd09-b7d124d41bac),volume_type_id=8474d47f-fd43-44d1-bd09-b7d124d41bac)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Creating volume e576f07a-19ff-420b-b4f0-68111d1f2bc2 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:59:53 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:53 devstack sudo[100363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2 1073741824
Jul 06 20:59:53 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Flow 'volume_create_manager' (d1360783-4b0a-46d2-8424-eecbcda44da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91feb551-6d4f-415a-a508-1cc32d192c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91feb551-6d4f-415a-a508-1cc32d192c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1924910374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a277a0c7-b3fb-45c5-93cb-4b8834696a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a579d88acff4607a68dc0bdb85689a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:53Z,use_quota=True,user_id='d665be012ee544769d693f5d421d85f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca40eee1-5f41-4b48-8890-c3d55399b48c),volume_type_id=ca40eee1-5f41-4b48-8890-c3d55399b48c)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360bbd64-f11e-4881-84cf-8326ba146990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (360bbd64-f11e-4881-84cf-8326ba146990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72937a9-5b72-411c-84fe-527cc8431da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f72937a9-5b72-411c-84fe-527cc8431da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a277a0c7-b3fb-45c5-93cb-4b8834696a7a', 'volume_name': 'volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d44f38-7496-4dfc-a5d3-7e50d9fb3498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1d44f38-7496-4dfc-a5d3-7e50d9fb3498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625215a4-1b76-4d02-aaa5-fde6b074a0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Volume a277a0c7-b3fb-45c5-93cb-4b8834696a7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a', 'volume_size': 1}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Flow 'volume_create_manager' (82a184c7-8621-4bcc-be4d-11ec621f9d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5c0cae-a9f5-434c-81f3-cb6773afaa3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5c0cae-a9f5-434c-81f3-cb6773afaa3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-238693818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396be8d1-e221-409b-a6e5-e81da6ad49f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a579d88acff4607a68dc0bdb85689a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:54Z,use_quota=True,user_id='d665be012ee544769d693f5d421d85f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a50ca12-da49-477e-a8cb-576c234ab2f3),volume_type_id=9a50ca12-da49-477e-a8cb-576c234ab2f3)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585b1437-e957-4e83-980e-f4876ff64fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585b1437-e957-4e83-980e-f4876ff64fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46188ec3-1942-4a11-aed5-1106217b3eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46188ec3-1942-4a11-aed5-1106217b3eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396be8d1-e221-409b-a6e5-e81da6ad49f2', 'volume_name': 'volume-396be8d1-e221-409b-a6e5-e81da6ad49f2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9595ebe-a0b5-4000-a8dc-ae926e8b0ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9595ebe-a0b5-4000-a8dc-ae926e8b0ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034b0c82-d50f-4d29-8f21-ff7bbdc0b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Volume 396be8d1-e221-409b-a6e5-e81da6ad49f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396be8d1-e221-409b-a6e5-e81da6ad49f2', 'volume_size': 1}
Jul 06 20:59:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:54 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2 1073741824" returned: 0 in 1.168s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:54 devstack sudo[100700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2
Jul 06 20:59:54 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Flow 'volume_create_manager' (f618673a-4533-4edb-8a6c-51e1ba30da2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49dcae85-0f2d-45c3-9008-73abe27176db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49dcae85-0f2d-45c3-9008-73abe27176db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-223579731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25c31d-136d-4b4a-9088-8beb577bcbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a579d88acff4607a68dc0bdb85689a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:55Z,use_quota=True,user_id='d665be012ee544769d693f5d421d85f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b337fcd-11dc-4150-88de-287fe67155c8),volume_type_id=2b337fcd-11dc-4150-88de-287fe67155c8)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df6f15a-530e-436f-8302-a6890aca188f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df6f15a-530e-436f-8302-a6890aca188f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4c590e-27b4-46af-9753-c4491a42ebfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:54 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 20:59:55 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2" returned: 0 in 1.090s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.334s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.903s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1924910374',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a277a0c7-b3fb-45c5-93cb-4b8834696a7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a579d88acff4607a68dc0bdb85689a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:53Z,use_quota=True,user_id='d665be012ee544769d693f5d421d85f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca40eee1-5f41-4b48-8890-c3d55399b48c),volume_type_id=ca40eee1-5f41-4b48-8890-c3d55399b48c)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Creating volume a277a0c7-b3fb-45c5-93cb-4b8834696a7a {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:59:55 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:55 devstack sudo[100708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a 1073741824
Jul 06 20:59:55 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd46e9d-5284-4475-8d37-3b95b9d31956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7218eb3-8afd-40fe-9394-0027ab7d11b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Volume volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2 (e576f07a-19ff-420b-b4f0-68111d1f2bc2): created successfully
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7218eb3-8afd-40fe-9394-0027ab7d11b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Flow 'volume_create_manager' (489e958e-9118-457a-a7ad-5435c7c5600d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8987b325-5791-4458-98e8-4a92bcc3c799 tempest-VolumeTypesAccessTest-1026058053 None] Created volume successfully.
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db4c590e-27b4-46af-9753-c4491a42ebfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9f25c31d-136d-4b4a-9088-8beb577bcbf2', 'volume_name': 'volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2', 'volume_size': 1, 'image_id': '93ca7a95-f93e-400e-a25f-47b08246b126', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93ca7a95-f93e-400e-a25f-47b08246b126', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1635285029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a579d88acff4607a68dc0bdb85689a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '93ca7a95-f93e-400e-a25f-47b08246b126', 'created_at': datetime.datetime(2026, 7, 6, 18, 59, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 59, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93ca7a95-f93e-400e-a25f-47b08246b126/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec1e3200>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfde8007-a6dd-43a9-8efe-2ccce89a1dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfde8007-a6dd-43a9-8efe-2ccce89a1dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c0ae88-5e13-4651-be43-8005618a710d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Volume 9f25c31d-136d-4b4a-9088-8beb577bcbf2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2', 'volume_size': 1, 'image_id': '93ca7a95-f93e-400e-a25f-47b08246b126', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93ca7a95-f93e-400e-a25f-47b08246b126', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1635285029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a579d88acff4607a68dc0bdb85689a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '93ca7a95-f93e-400e-a25f-47b08246b126', 'created_at': datetime.datetime(2026, 7, 6, 18, 59, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 59, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93ca7a95-f93e-400e-a25f-47b08246b126/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec1e3200>}
Jul 06 20:59:55 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Trying to clone 9f25c31d-136d-4b4a-9088-8beb577bcbf2 from image 93ca7a95-f93e-400e-a25f-47b08246b126 at location (None, [{'url': 'file:///opt/stack/data/glance/images/93ca7a95-f93e-400e-a25f-47b08246b126', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Acquiring lock "cinder-e576f07a-19ff-420b-b4f0-68111d1f2bc2-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Lock "cinder-e576f07a-19ff-420b-b4f0-68111d1f2bc2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Acquiring lock "cinder-quobyte-e576f07a-19ff-420b-b4f0-68111d1f2bc2" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Lock "cinder-quobyte-e576f07a-19ff-420b-b4f0-68111d1f2bc2" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb3f3b0-1179-4fc8-b90f-c56fffcef49a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:56 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a 1073741824" returned: 0 in 1.189s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:56 devstack sudo[100715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2
Jul 06 20:59:56 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:56 devstack sudo[100716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a
Jul 06 20:59:56 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:57 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a" returned: 0 in 0.885s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.520s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-238693818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396be8d1-e221-409b-a6e5-e81da6ad49f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a579d88acff4607a68dc0bdb85689a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:54Z,use_quota=True,user_id='d665be012ee544769d693f5d421d85f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a50ca12-da49-477e-a8cb-576c234ab2f3),volume_type_id=9a50ca12-da49-477e-a8cb-576c234ab2f3)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Creating volume 396be8d1-e221-409b-a6e5-e81da6ad49f2 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 20:59:57 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (625215a4-1b76-4d02-aaa5-fde6b074a0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eab248-5c69-477c-8db8-2ebefb88389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:57 devstack sudo[100723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 1073741824
Jul 06 20:59:57 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:57 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Volume volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a (a277a0c7-b3fb-45c5-93cb-4b8834696a7a): created successfully
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48eab248-5c69-477c-8db8-2ebefb88389a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Flow 'volume_create_manager' (d1360783-4b0a-46d2-8424-eecbcda44da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:57 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2" returned: 0 in 1.116s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:57 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4b83f9c2-2bc1-413a-af8b-c4af9e7d39c1 tempest-TestInstancesWithCinderVolumes-954153539 None] Created volume successfully.
Jul 06 20:59:57 devstack sudo[100725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2
Jul 06 20:59:57 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:58 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e576f07a-19ff-420b-b4f0-68111d1f2bc2" returned: 0 in 0.925s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Lock "cinder-quobyte-e576f07a-19ff-420b-b4f0-68111d1f2bc2" released by "delete_volume" :: held 2.094s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 20:59:58 devstack cinder-volume[86721]: WARNING cinder.quota [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1755683731 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1755683731, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:59:58 devstack cinder-volume[86721]: WARNING cinder.quota [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1755683731 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1755683731, it is now deprecated. Please use the default quota class for default quota.
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Created reservations ['4d2b0ad3-5733-43d8-a009-0c32b6c442b7', '3227f8eb-9864-4830-860c-d8016b4bd3b3', '23e60ac9-3ebe-4d88-adef-e54b54875b97', 'a0607694-8221-4ca2-9ba6-cd72bc09106f'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 20:59:58 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 1073741824" returned: 0 in 1.207s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 20:59:58 devstack sudo[100734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2
Jul 06 20:59:58 devstack sudo[100734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:58 devstack sudo[100735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 20:59:58 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 20:59:59 devstack sudo[100734]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2" returned: 0 in 0.822s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.105s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (034b0c82-d50f-4d29-8f21-ff7bbdc0b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396be8d1-e221-409b-a6e5-e81da6ad49f2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bdafcd-0bc2-4213-a183-86d436192abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 20:59:59 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Volume volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 (396be8d1-e221-409b-a6e5-e81da6ad49f2): created successfully
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bdafcd-0bc2-4213-a183-86d436192abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Flow 'volume_create_manager' (82a184c7-8621-4bcc-be4d-11ec621f9d7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 20:59:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-31a589ac-77c4-4792-a600-1cf4f4c2714f tempest-TestInstancesWithCinderVolumes-954153539 None] Created volume successfully.
Jul 06 20:59:59 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.933s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 20:59:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Deleted volume successfully.
Jul 06 20:59:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5507d975-e1e8-465f-8cc0-340761766790 tempest-VolumeTypesAccessTest-1026058053 None] Lock "cinder-e576f07a-19ff-420b-b4f0-68111d1f2bc2-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:00 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD, size 20.69 MB, duration 4.64 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 21:00:00 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Image download 20.69 MB at 4.45 MB/s
Jul 06 21:00:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0560773-c801-448a-a504-59fcbd9f9b39]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:00 devstack sudo[100740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD
Jul 06 21:00:00 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:01 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Temporary image 93ca7a95-f93e-400e-a25f-47b08246b126 is fetched for user d665be012ee544769d693f5d421d85f1. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffd55b0-64ed-4634-b2d5-2933ddb1bef7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:01 devstack sudo[100745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD
Jul 06 21:00:01 devstack sudo[100745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:01 devstack sudo[100745]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD" returned: 0 in 0.817s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T18:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-223579731',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f25c31d-136d-4b4a-9088-8beb577bcbf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a579d88acff4607a68dc0bdb85689a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T18:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T18:59:55Z,use_quota=True,user_id='d665be012ee544769d693f5d421d85f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b337fcd-11dc-4150-88de-287fe67155c8),volume_type_id=2b337fcd-11dc-4150-88de-287fe67155c8)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Creating volume 9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:00:01 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:00:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:02 devstack sudo[100750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 1073741824
Jul 06 21:00:02 devstack sudo[100750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:02 devstack sudo[100750]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 1073741824" returned: 0 in 0.945s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:03 devstack sudo[100756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:00:03 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:03 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 0 in 0.780s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:00:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:03 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Attempting download of 93ca7a95-f93e-400e-a25f-47b08246b126 ((None, [{'url': 'file:///opt/stack/data/glance/images/93ca7a95-f93e-400e-a25f-47b08246b126', 'metadata': {}}])) to volume 9f25c31d-136d-4b4a-9088-8beb577bcbf2. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 21:00:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[277fb2c8-5fa2-4bde-aa27-cffa736901e6]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93ca7a95-f93e-400e-a25f-47b08246b126_b6hi38sw {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:03 devstack sudo[100759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93ca7a95-f93e-400e-a25f-47b08246b126_b6hi38sw
Jul 06 21:00:03 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:04 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_93ca7a95-f93e-400e-a25f-47b08246b126_b6hi38sw" returned: 0 in 0.850s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93ca7a95-f93e-400e-a25f-47b08246b126_b6hi38sw {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:04 devstack sudo[100763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93ca7a95-f93e-400e-a25f-47b08246b126_b6hi38sw
Jul 06 21:00:04 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:05 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93ca7a95-f93e-400e-a25f-47b08246b126_b6hi38sw" returned: 1 in 0.827s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_93ca7a95-f93e-400e-a25f-47b08246b126_b6hi38sw' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:00:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[969ea5e1-7d30-46eb-a838-85518f801ecb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:05 devstack sudo[100770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD
Jul 06 21:00:05 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:06 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:06 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] 93ca7a95-f93e-400e-a25f-47b08246b126 was qcow2, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 21:00:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:06 devstack sudo[100775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:00:06 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:08 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 0 in 2.167s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:08 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_93ca7a95-f93e-400e-a25f-47b08246b126_s1vr98uvdevstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:00:08 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Converted 112.00 MB image at 51.62 MB/s
Jul 06 21:00:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:08 devstack sudo[100791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 1G
Jul 06 21:00:08 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:09 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 1G" returned: 0 in 0.757s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e0b382-450d-4d32-90de-9ed19920d9e1]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:09 devstack sudo[100796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:00:09 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:10 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 0 in 0.983s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:10 devstack sudo[100867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:00:10 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:11 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 1 in 0.845s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Downloaded image 93ca7a95-f93e-400e-a25f-47b08246b126 ((None, [{'url': 'file:///opt/stack/data/glance/images/93ca7a95-f93e-400e-a25f-47b08246b126', 'metadata': {}}])) to volume 9f25c31d-136d-4b4a-9088-8beb577bcbf2 successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Temporary image 93ca7a95-f93e-400e-a25f-47b08246b126 for user d665be012ee544769d693f5d421d85f1 is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Marking volume 9f25c31d-136d-4b4a-9088-8beb577bcbf2 as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Copying metadata from image 93ca7a95-f93e-400e-a25f-47b08246b126 to 9f25c31d-136d-4b4a-9088-8beb577bcbf2. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Creating volume glance metadata for volume 9f25c31d-136d-4b4a-9088-8beb577bcbf2 backed by image 93ca7a95-f93e-400e-a25f-47b08246b126 with: {'image_id': '93ca7a95-f93e-400e-a25f-47b08246b126', 'image_name': 'tempest-scenario-img--1635285029', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c0ae88-5e13-4651-be43-8005618a710d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2', 'volume_size': 1, 'image_id': '93ca7a95-f93e-400e-a25f-47b08246b126', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/93ca7a95-f93e-400e-a25f-47b08246b126', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1635285029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9a579d88acff4607a68dc0bdb85689a9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '93ca7a95-f93e-400e-a25f-47b08246b126', 'created_at': datetime.datetime(2026, 7, 6, 18, 59, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 59, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/93ca7a95-f93e-400e-a25f-47b08246b126/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec1e3200>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42da213-4c6f-42d6-9cb5-ba9b9adb485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:11 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Volume volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 (9f25c31d-136d-4b4a-9088-8beb577bcbf2): created successfully
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f42da213-4c6f-42d6-9cb5-ba9b9adb485d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Flow 'volume_create_manager' (f618673a-4533-4edb-8a6c-51e1ba30da2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:00:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6c6c04d5-e065-4246-9f30-fd7c6c8008b6 tempest-TestInstancesWithCinderVolumes-954153539 None] Created volume successfully.
Jul 06 21:00:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc37335-7cc4-4cc8-9514-2e33948cc839]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:20 devstack sudo[100886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:00:20 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:20 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 0 in 0.935s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:21 devstack sudo[100890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:00:21 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:21 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 1 in 0.962s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:00:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.963s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e217dba-e8f6-41f1-a54a-e5f53231514f', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:00:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-e9875cd7-f45b-4a6c-80c8-35923447f274 req-6f2392d4-0605-4436-aefa-34420d678e04 tempest-TestInstancesWithCinderVolumes-954153539 None] attachment_update completed successfully.
Jul 06 21:00:31 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=7,cinder:DELETE=2 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:00:31 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=24,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=10 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:00:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:00:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:00:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:00:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:37 devstack sudo[101003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:00:37 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-b6042f16-b986-4d02-9a52-2dcaa3462c50 tempest-TestShelveInstance-1958325446 None] Terminate volume connection completed successfully.
Jul 06 21:00:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-b6042f16-b986-4d02-9a52-2dcaa3462c50 tempest-TestShelveInstance-1958325446 None] Deleting attachment 53eabec1-f9fc-4477-983b-cc1e38ed1caf. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:00:39 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.518s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Acquiring lock "cinder-d68f2f64-b224-4f1b-81f8-b151cdefa56c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Lock "cinder-d68f2f64-b224-4f1b-81f8-b151cdefa56c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Acquiring lock "cinder-quobyte-d68f2f64-b224-4f1b-81f8-b151cdefa56c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Lock "cinder-quobyte-d68f2f64-b224-4f1b-81f8-b151cdefa56c" acquired by "delete_volume" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[815d02e3-6164-4975-9d16-32f797c651b6]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:39 devstack sudo[101025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 21:00:39 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:40 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 0 in 1.297s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:41 devstack sudo[101032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 21:00:41 devstack sudo[101032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:41 devstack sudo[101032]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 1 in 0.950s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:00:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:41 devstack sudo[101039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c
Jul 06 21:00:41 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:43 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d68f2f64-b224-4f1b-81f8-b151cdefa56c" returned: 0 in 1.116s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Lock "cinder-quobyte-d68f2f64-b224-4f1b-81f8-b151cdefa56c" released by "delete_volume" :: held 3.530s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG cinder.quota [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Created reservations ['927c72c5-d883-4cc7-84b3-e3f17214ea2d', '54491787-c94d-4a6d-8461-51a41854b3e9', '4d5ee492-d3ae-45f9-adfc-2584597c423a', 'ad13c11b-33bb-4764-93b6-6dfe917c960c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:43 devstack sudo[101043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:00:43 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:44 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.905s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:44 devstack cinder-volume[86721]: DEBUG cinder.manager [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:00:44 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Deleted volume successfully.
Jul 06 21:00:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [req-59a4dbc8-d896-4900-b21e-314774b32ee2 req-e2c9bd67-c878-449d-85d7-1779ef36e084 tempest-TestShelveInstance-1958325446 None] Lock "cinder-d68f2f64-b224-4f1b-81f8-b151cdefa56c-delete_volume" released by "delete_volume" :: held 4.915s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:50 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:00:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (7d7a60c9-15db-4364-99f2-14bfb97ad359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:00:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3894d682-95e2-4be7-bbed-9951e22330cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3894d682-95e2-4be7-bbed-9951e22330cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741514895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1055b1bf-8ee6-4bce-9ce2-765f030b402f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:51Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2ee978-e849-4ffb-a03d-310052bb67bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb2ee978-e849-4ffb-a03d-310052bb67bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611cbb3c-3efd-4176-8b15-884d59c33281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (611cbb3c-3efd-4176-8b15-884d59c33281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1055b1bf-8ee6-4bce-9ce2-765f030b402f', 'volume_name': 'volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e77393-653a-49fd-98e7-84fb5840f737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e77393-653a-49fd-98e7-84fb5840f737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d50dbb8-3bd9-4263-aa5e-333eb6897965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Volume 1055b1bf-8ee6-4bce-9ce2-765f030b402f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f', 'volume_size': 1}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1741514895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1055b1bf-8ee6-4bce-9ce2-765f030b402f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:00:51Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Creating volume 1055b1bf-8ee6-4bce-9ce2-765f030b402f {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:00:51 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:00:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:51 devstack sudo[101185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f 1073741824
Jul 06 21:00:51 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:52 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f 1073741824" returned: 0 in 1.025s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:52 devstack sudo[101192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f
Jul 06 21:00:52 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:52 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f" returned: 0 in 0.658s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d50dbb8-3bd9-4263-aa5e-333eb6897965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd48215a-add7-41f3-a0e2-eb44b1d1f8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:52 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Volume volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f (1055b1bf-8ee6-4bce-9ce2-765f030b402f): created successfully
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd48215a-add7-41f3-a0e2-eb44b1d1f8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (7d7a60c9-15db-4364-99f2-14bfb97ad359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:00:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a484f826-5c07-4f2d-91d0-a64d5d72773e tempest-VolumesActionsTest-273520518 None] Created volume successfully.
Jul 06 21:00:52 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c6e7a08b-f933-409b-a576-fd27d7f9731f tempest-VolumesActionsTest-273520518 None] Acquiring lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f" by "attach_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:00:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c6e7a08b-f933-409b-a576-fd27d7f9731f tempest-VolumesActionsTest-273520518 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f" acquired by "attach_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:00:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c6e7a08b-f933-409b-a576-fd27d7f9731f tempest-VolumesActionsTest-273520518 None] Attaching volume 1055b1bf-8ee6-4bce-9ce2-765f030b402f to instance 32e81e68-3f6d-4b98-b0e4-13757bbb9a99 at mountpoint /dev/vdb on host None.
Jul 06 21:00:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c6e7a08b-f933-409b-a576-fd27d7f9731f tempest-VolumesActionsTest-273520518 None] Attach volume completed successfully.
Jul 06 21:00:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c6e7a08b-f933-409b-a576-fd27d7f9731f tempest-VolumesActionsTest-273520518 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f" released by "attach_volume" :: held 0.182s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7685ab08-e57b-4cb8-a26e-8199f3c9d9f9 tempest-VolumesActionsTest-1307136058 None] Terminate volume connection completed successfully.
Jul 06 21:00:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7685ab08-e57b-4cb8-a26e-8199f3c9d9f9 tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-detach_volume" by "detach_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:00:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7685ab08-e57b-4cb8-a26e-8199f3c9d9f9 tempest-VolumesActionsTest-1307136058 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:00:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7685ab08-e57b-4cb8-a26e-8199f3c9d9f9 tempest-VolumesActionsTest-1307136058 None] Detaching volume 1055b1bf-8ee6-4bce-9ce2-765f030b402f from instance 32e81e68-3f6d-4b98-b0e4-13757bbb9a99.
Jul 06 21:00:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7685ab08-e57b-4cb8-a26e-8199f3c9d9f9 tempest-VolumesActionsTest-1307136058 None] Detach volume completed successfully.
Jul 06 21:00:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7685ab08-e57b-4cb8-a26e-8199f3c9d9f9 tempest-VolumesActionsTest-1307136058 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9ab33ac-acfc-4abf-9502-833b7796d06a tempest-VolumesActionsTest-273520518 None] Acquiring lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-detach_volume" by "detach_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:00:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9ab33ac-acfc-4abf-9502-833b7796d06a tempest-VolumesActionsTest-273520518 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:00:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b9ab33ac-acfc-4abf-9502-833b7796d06a tempest-VolumesActionsTest-273520518 None] Volume detach called, but volume not attached.
Jul 06 21:00:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9ab33ac-acfc-4abf-9502-833b7796d06a tempest-VolumesActionsTest-273520518 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Acquiring lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:00:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:00:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Acquiring lock "cinder-quobyte-1055b1bf-8ee6-4bce-9ce2-765f030b402f" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:00:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Lock "cinder-quobyte-1055b1bf-8ee6-4bce-9ce2-765f030b402f" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:00:56 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5273ae7e-af75-4824-b9f0-7bf390e2d8ed]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:00:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:56 devstack sudo[101200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f
Jul 06 21:00:56 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:57 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f" returned: 0 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:57 devstack sudo[101208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f
Jul 06 21:00:57 devstack sudo[101208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:58 devstack sudo[101208]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1055b1bf-8ee6-4bce-9ce2-765f030b402f" returned: 0 in 0.779s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Lock "cinder-quobyte-1055b1bf-8ee6-4bce-9ce2-765f030b402f" released by "delete_volume" :: held 1.711s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Created reservations ['4a567dc1-7da2-4ad8-a066-eae94466aae8', 'dd306740-839b-42db-a3f4-2233084680b3', '4c2ad745-e855-4f41-bc2b-39db3512e265', 'fdc7056c-5678-4c2e-9da3-c85209fa5c7a'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:00:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:00:58 devstack sudo[101212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:00:58 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:00:59 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.036s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:00:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Deleted volume successfully.
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8e93609d-418d-4be8-b0a6-4fdb35f47936 tempest-VolumesActionsTest-273520518 None] Lock "cinder-1055b1bf-8ee6-4bce-9ce2-765f030b402f-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Flow 'volume_create_manager' (617ffea6-0b5b-418f-ac09-cd04e29ebf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf2f636-f6f0-4cb5-aa76-181090f40533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bf2f636-f6f0-4cb5-aa76-181090f40533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71015a0-2846-4c67-9ce9-e62ba810505b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af67671c3df487bb9495d276bea8dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:00Z,use_quota=True,user_id='b748730a9b9b47a4a1bf3491dddcb01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf1815e-be59-44c9-ad7a-a5f24b502e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf1815e-be59-44c9-ad7a-a5f24b502e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e822071-21be-454d-be77-199f74278a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:00:59 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e822071-21be-454d-be77-199f74278a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd71015a0-2846-4c67-9ce9-e62ba810505b', 'volume_name': 'volume-d71015a0-2846-4c67-9ce9-e62ba810505b', 'volume_size': 1, 'image_id': '8179f636-31ec-4933-861b-7ad52d8f795b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8179f636-31ec-4933-861b-7ad52d8f795b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31952b194c1e204403412d50b251ddcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8af67671c3df487bb9495d276bea8dd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d2babfd27a10ede5d3a62c16fc84eda96191d90ecb37f26e2f1c0cb4f98a89c1f44df0418d09ca5fffaaa42b53ba7ccbbbaa693b9e155ba08838cd9f4f0a253', 'id': '8179f636-31ec-4933-861b-7ad52d8f795b', 'created_at': datetime.datetime(2026, 7, 6, 19, 0, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 0, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8179f636-31ec-4933-861b-7ad52d8f795b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec415670>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01208ed2-9ef3-4e83-b9e6-4e7c2dee6949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01208ed2-9ef3-4e83-b9e6-4e7c2dee6949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5e7ac0-c2ea-40cf-9ac8-d3a7cf652a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Volume d71015a0-2846-4c67-9ce9-e62ba810505b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d71015a0-2846-4c67-9ce9-e62ba810505b', 'volume_size': 1, 'image_id': '8179f636-31ec-4933-861b-7ad52d8f795b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8179f636-31ec-4933-861b-7ad52d8f795b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31952b194c1e204403412d50b251ddcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8af67671c3df487bb9495d276bea8dd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d2babfd27a10ede5d3a62c16fc84eda96191d90ecb37f26e2f1c0cb4f98a89c1f44df0418d09ca5fffaaa42b53ba7ccbbbaa693b9e155ba08838cd9f4f0a253', 'id': '8179f636-31ec-4933-861b-7ad52d8f795b', 'created_at': datetime.datetime(2026, 7, 6, 19, 0, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 0, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8179f636-31ec-4933-861b-7ad52d8f795b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec415670>}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Trying to clone d71015a0-2846-4c67-9ce9-e62ba810505b from image 8179f636-31ec-4933-861b-7ad52d8f795b at location (None, [{'url': 'file:///opt/stack/data/glance/images/8179f636-31ec-4933-861b-7ad52d8f795b', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 21:01:00 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9ea8b5-a87d-4244-9203-c146d574e69c]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:00 devstack sudo[101221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD
Jul 06 21:01:00 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-9769b1d1-2da7-4008-ba40-c8a26e8a1b18 req-b503f4f2-61dd-41cd-b766-f3ea8cad51f6 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-9769b1d1-2da7-4008-ba40-c8a26e8a1b18 req-b503f4f2-61dd-41cd-b766-f3ea8cad51f6 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[49102f41-68a3-4148-adec-0a96fbc5a4ca]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-9769b1d1-2da7-4008-ba40-c8a26e8a1b18 req-b503f4f2-61dd-41cd-b766-f3ea8cad51f6 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:00 devstack sudo[101230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a
Jul 06 21:01:00 devstack sudo[101230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:01 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD" returned: 0 in 0.929s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:01 devstack sudo[101250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD
Jul 06 21:01:01 devstack sudo[101250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:01 devstack sudo[101230]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-9769b1d1-2da7-4008-ba40-c8a26e8a1b18 req-b503f4f2-61dd-41cd-b766-f3ea8cad51f6 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a" returned: 0 in 1.128s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-9769b1d1-2da7-4008-ba40-c8a26e8a1b18 req-b503f4f2-61dd-41cd-b766-f3ea8cad51f6 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.151s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-9769b1d1-2da7-4008-ba40-c8a26e8a1b18 req-b503f4f2-61dd-41cd-b766-f3ea8cad51f6 tempest-TestInstancesWithCinderVolumes-954153539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e35d7270-77f8-494b-b783-76d6ed5c5809', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:01:01 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-9769b1d1-2da7-4008-ba40-c8a26e8a1b18 req-b503f4f2-61dd-41cd-b766-f3ea8cad51f6 tempest-TestInstancesWithCinderVolumes-954153539 None] attachment_update completed successfully.
Jul 06 21:01:02 devstack sudo[101250]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD" returned: 1 in 0.990s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:01:02 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Temporary image 8179f636-31ec-4933-861b-7ad52d8f795b is fetched for user b748730a9b9b47a4a1bf3491dddcb01c. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 21:01:02 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a2012b-cf08-4038-a5f4-bb59aa0af952]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:02 devstack sudo[101263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD
Jul 06 21:01:02 devstack sudo[101263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:03 devstack sudo[101263]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:03 devstack sudo[101269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD
Jul 06 21:01:03 devstack sudo[101269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:03 devstack sudo[101269]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD" returned: 1 in 0.798s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71015a0-2846-4c67-9ce9-e62ba810505b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af67671c3df487bb9495d276bea8dd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:00Z,use_quota=True,user_id='b748730a9b9b47a4a1bf3491dddcb01c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Creating volume d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:03 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:03 devstack sudo[101274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b 1073741824
Jul 06 21:01:03 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:04 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b 1073741824" returned: 0 in 0.842s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:04 devstack sudo[101279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b
Jul 06 21:01:04 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:05 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b" returned: 0 in 0.686s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:05 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Attempting download of 8179f636-31ec-4933-861b-7ad52d8f795b ((None, [{'url': 'file:///opt/stack/data/glance/images/8179f636-31ec-4933-861b-7ad52d8f795b', 'metadata': {}}])) to volume d71015a0-2846-4c67-9ce9-e62ba810505b. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 21:01:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d0de21-a143-4089-9afa-48d1dcc94b95]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8179f636-31ec-4933-861b-7ad52d8f795b_9wv035ug {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:05 devstack sudo[101282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8179f636-31ec-4933-861b-7ad52d8f795b_9wv035ug
Jul 06 21:01:05 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:06 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8179f636-31ec-4933-861b-7ad52d8f795b_9wv035ug" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8179f636-31ec-4933-861b-7ad52d8f795b_9wv035ug {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:06 devstack sudo[101295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8179f636-31ec-4933-861b-7ad52d8f795b_9wv035ug
Jul 06 21:01:06 devstack sudo[101295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:07 devstack sudo[101295]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8179f636-31ec-4933-861b-7ad52d8f795b_9wv035ug" returned: 1 in 0.746s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8179f636-31ec-4933-861b-7ad52d8f795b_9wv035ug' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a649152a-951c-44c8-bb67-de0e193f61fb]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (f2fb9d3a-b788-4b49-a1a1-2b3e4b8a2128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cf3862-f2a3-4836-9d3e-17a091c86bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:07 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD
Jul 06 21:01:07 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cf3862-f2a3-4836-9d3e-17a091c86bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1223584101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa17a3f-cd97-4629-a850-0af7630f1e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:07Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714a573d-2070-4229-9a7f-8793bac7f7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (714a573d-2070-4229-9a7f-8793bac7f7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54dc3178-de10-46ab-8438-7b10fde263d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54dc3178-de10-46ab-8438-7b10fde263d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9aa17a3f-cd97-4629-a850-0af7630f1e54', 'volume_name': 'volume-9aa17a3f-cd97-4629-a850-0af7630f1e54', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca322eda-9ff8-4f33-b436-d7796c67f97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca322eda-9ff8-4f33-b436-d7796c67f97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25635483-786d-4655-82fd-c90ab364cc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:07 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Volume 9aa17a3f-cd97-4629-a850-0af7630f1e54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9aa17a3f-cd97-4629-a850-0af7630f1e54', 'volume_size': 1}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1223584101',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9aa17a3f-cd97-4629-a850-0af7630f1e54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:07Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Creating volume 9aa17a3f-cd97-4629-a850-0af7630f1e54 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:07 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:07 devstack sudo[101301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54 1073741824
Jul 06 21:01:07 devstack sudo[101301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:07 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:07 devstack sudo[101308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD
Jul 06 21:01:07 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:08 devstack sudo[101301]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54 1073741824" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:08 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54
Jul 06 21:01:08 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:08 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD" returned: 1 in 0.785s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] 8179f636-31ec-4933-861b-7ad52d8f795b was raw, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:08 devstack sudo[101317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b
Jul 06 21:01:08 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:08 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54" returned: 0 in 0.691s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25635483-786d-4655-82fd-c90ab364cc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9aa17a3f-cd97-4629-a850-0af7630f1e54', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d9981d-ef9d-4c3b-9ba3-d8c334428a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:08 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Volume volume-9aa17a3f-cd97-4629-a850-0af7630f1e54 (9aa17a3f-cd97-4629-a850-0af7630f1e54): created successfully
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d9981d-ef9d-4c3b-9ba3-d8c334428a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:08 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (f2fb9d3a-b788-4b49-a1a1-2b3e4b8a2128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b055d292-b23c-4c9d-bd1a-6f885f48ef44 tempest-VolumesActionsTest-273520518 None] Created volume successfully.
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-3e417960-8519-42d7-99f2-22ccf4db14d3 req-95677144-970f-4446-8cd3-f62bcd37b1c9 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-3e417960-8519-42d7-99f2-22ccf4db14d3 req-95677144-970f-4446-8cd3-f62bcd37b1c9 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[966a2813-699e-4cdd-8f8e-2679f5f55e80]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-3e417960-8519-42d7-99f2-22ccf4db14d3 req-95677144-970f-4446-8cd3-f62bcd37b1c9 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:09 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2
Jul 06 21:01:09 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-9aa17a3f-cd97-4629-a850-0af7630f1e54-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Lock "cinder-9aa17a3f-cd97-4629-a850-0af7630f1e54-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:09 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b" returned: 0 in 0.828s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8179f636-31ec-4933-861b-7ad52d8f795b__yurw97idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:01:09 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-quobyte-9aa17a3f-cd97-4629-a850-0af7630f1e54" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:09 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b 1G
Jul 06 21:01:09 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-9aa17a3f-cd97-4629-a850-0af7630f1e54" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ec45cf-d782-4832-9ad0-91e8f96723ef]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:09 devstack sudo[101335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54
Jul 06 21:01:09 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:10 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-3e417960-8519-42d7-99f2-22ccf4db14d3 req-95677144-970f-4446-8cd3-f62bcd37b1c9 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2" returned: 0 in 0.937s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-3e417960-8519-42d7-99f2-22ccf4db14d3 req-95677144-970f-4446-8cd3-f62bcd37b1c9 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.955s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-3e417960-8519-42d7-99f2-22ccf4db14d3 req-95677144-970f-4446-8cd3-f62bcd37b1c9 tempest-TestInstancesWithCinderVolumes-954153539 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-396be8d1-e221-409b-a6e5-e81da6ad49f2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e5312906-f2da-4caa-9dd6-15a0a6dbc41d', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:01:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-3e417960-8519-42d7-99f2-22ccf4db14d3 req-95677144-970f-4446-8cd3-f62bcd37b1c9 tempest-TestInstancesWithCinderVolumes-954153539 None] attachment_update completed successfully.
Jul 06 21:01:10 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b 1G" returned: 0 in 0.792s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b01399-9658-4312-94ef-7f96dfa26fe0]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:10 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54" returned: 0 in 0.867s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:10 devstack sudo[101383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54
Jul 06 21:01:10 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:10 devstack sudo[101380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b
Jul 06 21:01:10 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:11 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b" returned: 0 in 0.797s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:11 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9aa17a3f-cd97-4629-a850-0af7630f1e54" returned: 0 in 0.736s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-9aa17a3f-cd97-4629-a850-0af7630f1e54" released by "delete_volume" :: held 1.654s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Created reservations ['b9210353-f063-4b19-a207-ddd79992d3b7', '36c461f9-778c-4f11-9f5b-83d8fb25df67', '5044700f-1717-40f6-9ad7-97dd0f3df03b', '7a06a377-806e-4bec-a6f2-ebde5b9dbfc0'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:11 devstack sudo[101389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b
Jul 06 21:01:11 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:11 devstack sudo[101393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:11 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:12 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b" returned: 1 in 0.925s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Downloaded image 8179f636-31ec-4933-861b-7ad52d8f795b ((None, [{'url': 'file:///opt/stack/data/glance/images/8179f636-31ec-4933-861b-7ad52d8f795b', 'metadata': {}}])) to volume d71015a0-2846-4c67-9ce9-e62ba810505b successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Temporary image 8179f636-31ec-4933-861b-7ad52d8f795b for user b748730a9b9b47a4a1bf3491dddcb01c is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Marking volume d71015a0-2846-4c67-9ce9-e62ba810505b as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Copying metadata from image 8179f636-31ec-4933-861b-7ad52d8f795b to d71015a0-2846-4c67-9ce9-e62ba810505b. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Creating volume glance metadata for volume d71015a0-2846-4c67-9ce9-e62ba810505b backed by image 8179f636-31ec-4933-861b-7ad52d8f795b with: {'image_id': '8179f636-31ec-4933-861b-7ad52d8f795b', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '31952b194c1e204403412d50b251ddcc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 21:01:12 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.758s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Deleted volume successfully.
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddd16656-6a68-4769-a337-0ce9abc0aeec tempest-VolumesActionsTest-1307136058 None] Lock "cinder-9aa17a3f-cd97-4629-a850-0af7630f1e54-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a5e7ac0-c2ea-40cf-9ac8-d3a7cf652a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71015a0-2846-4c67-9ce9-e62ba810505b', 'volume_size': 1, 'image_id': '8179f636-31ec-4933-861b-7ad52d8f795b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8179f636-31ec-4933-861b-7ad52d8f795b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '31952b194c1e204403412d50b251ddcc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8af67671c3df487bb9495d276bea8dd2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7d2babfd27a10ede5d3a62c16fc84eda96191d90ecb37f26e2f1c0cb4f98a89c1f44df0418d09ca5fffaaa42b53ba7ccbbbaa693b9e155ba08838cd9f4f0a253', 'id': '8179f636-31ec-4933-861b-7ad52d8f795b', 'created_at': datetime.datetime(2026, 7, 6, 19, 0, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 0, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8179f636-31ec-4933-861b-7ad52d8f795b/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec415670>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c5473b-d25a-48fd-aa86-306784d660cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Volume volume-d71015a0-2846-4c67-9ce9-e62ba810505b (d71015a0-2846-4c67-9ce9-e62ba810505b): created successfully
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43c5473b-d25a-48fd-aa86-306784d660cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Flow 'volume_create_manager' (617ffea6-0b5b-418f-ac09-cd04e29ebf7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:12 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3111c7e9-7136-47e1-a33f-f41e3f2a3a2a tempest-VolumeImageDependencyTests-1932764412 None] Created volume successfully.
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (15323c94-e65f-461e-9236-a80ece482da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a327fb7-2a2e-4c05-84af-23c0de07d2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a327fb7-2a2e-4c05-84af-23c0de07d2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1254899688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd093aaf-eebb-4fde-8148-af55bd24af0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:12Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a15ca6-e1f4-4e59-a2b4-157eeeed4476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a15ca6-e1f4-4e59-a2b4-157eeeed4476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856e4b27-efb2-4a68-a417-15b1ca7bb0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (856e4b27-efb2-4a68-a417-15b1ca7bb0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd093aaf-eebb-4fde-8148-af55bd24af0c', 'volume_name': 'volume-dd093aaf-eebb-4fde-8148-af55bd24af0c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69486b3e-6ef1-4091-b08e-ed8aedc96bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69486b3e-6ef1-4091-b08e-ed8aedc96bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8072e1-63be-4e4a-9e15-fcc8350ce19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Volume dd093aaf-eebb-4fde-8148-af55bd24af0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd093aaf-eebb-4fde-8148-af55bd24af0c', 'volume_size': 1}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1254899688',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd093aaf-eebb-4fde-8148-af55bd24af0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:12Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Creating volume dd093aaf-eebb-4fde-8148-af55bd24af0c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:12 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:12 devstack sudo[101399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c 1073741824
Jul 06 21:01:12 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Acquiring lock "cinder-d71015a0-2846-4c67-9ce9-e62ba810505b-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Lock "cinder-d71015a0-2846-4c67-9ce9-e62ba810505b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Acquiring lock "cinder-quobyte-d71015a0-2846-4c67-9ce9-e62ba810505b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Lock "cinder-quobyte-d71015a0-2846-4c67-9ce9-e62ba810505b" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5db6ec6-9889-4abe-883a-fa09800d957a]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:12 devstack sudo[101401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b
Jul 06 21:01:12 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:13 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c 1073741824" returned: 0 in 0.897s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:13 devstack sudo[101407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c
Jul 06 21:01:13 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:13 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b" returned: 0 in 0.792s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:13 devstack sudo[101412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b
Jul 06 21:01:13 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:13 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c" returned: 0 in 0.703s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8072e1-63be-4e4a-9e15-fcc8350ce19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd093aaf-eebb-4fde-8148-af55bd24af0c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f638c3-8c8b-4250-850f-97ff82f6f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:14 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Volume volume-dd093aaf-eebb-4fde-8148-af55bd24af0c (dd093aaf-eebb-4fde-8148-af55bd24af0c): created successfully
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33f638c3-8c8b-4250-850f-97ff82f6f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (15323c94-e65f-461e-9236-a80ece482da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:14 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0a02b41a-d122-48e2-9792-333ab0d2c871 tempest-VolumesActionsTest-273520518 None] Created volume successfully.
Jul 06 21:01:14 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b" returned: 1 in 0.802s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:14 devstack sudo[101418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b
Jul 06 21:01:14 devstack sudo[101418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-dd093aaf-eebb-4fde-8148-af55bd24af0c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Lock "cinder-dd093aaf-eebb-4fde-8148-af55bd24af0c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-quobyte-dd093aaf-eebb-4fde-8148-af55bd24af0c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-dd093aaf-eebb-4fde-8148-af55bd24af0c" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b75fc1-d98b-446d-bfed-55ab170fb535]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:14 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c
Jul 06 21:01:14 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:15 devstack sudo[101418]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d71015a0-2846-4c67-9ce9-e62ba810505b" returned: 0 in 0.689s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Lock "cinder-quobyte-d71015a0-2846-4c67-9ce9-e62ba810505b" released by "delete_volume" :: held 2.347s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Created reservations ['ec74e1fd-47a4-4e36-a1ff-137f73acd2a6', 'fb848b0c-e450-47b0-9a68-cfef0d845dbd', '9089464e-1384-4095-a051-d6caa6ac1032', '824fb9ae-5aed-464a-957c-197d729c8913'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:15 devstack sudo[101424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:15 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:15 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c" returned: 0 in 0.938s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:15 devstack sudo[101436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c
Jul 06 21:01:15 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:16 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.995s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Deleted volume successfully.
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3f3dd502-8029-45b0-b407-a4aae29b6f23 tempest-VolumeImageDependencyTests-1932764412 None] Lock "cinder-d71015a0-2846-4c67-9ce9-e62ba810505b-delete_volume" released by "delete_volume" :: held 3.634s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:16 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dd093aaf-eebb-4fde-8148-af55bd24af0c" returned: 0 in 1.077s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-dd093aaf-eebb-4fde-8148-af55bd24af0c" released by "delete_volume" :: held 2.066s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Created reservations ['36eb1dda-2fc0-4bd6-862b-4684b8860538', '019bd945-7603-4d84-9720-310510e3b870', '58e52ee2-bdcc-417a-9333-9d4cc3d2e22c', '4423dba9-bcc9-4f5d-92b0-87b2eb4fa483'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:16 devstack sudo[101442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:16 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:17 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.930s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:17 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Deleted volume successfully.
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (bd192ad5-6746-47d9-a1da-8f988fd91c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce3ece2-6532-4e58-bfc7-6f35c76c4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-08c02688-aa1b-4bdc-bf63-874af3d6a07d tempest-VolumesActionsTest-1307136058 None] Lock "cinder-dd093aaf-eebb-4fde-8148-af55bd24af0c-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce3ece2-6532-4e58-bfc7-6f35c76c4386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911690289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86497c2c-87ec-4fbb-bfed-3adcdc2fadb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:18Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d0de56-07f7-4418-8b3f-e7f1a3ce47d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25d0de56-07f7-4418-8b3f-e7f1a3ce47d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c79734-2502-4982-8539-f55bf3b1cef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c79734-2502-4982-8539-f55bf3b1cef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86497c2c-87ec-4fbb-bfed-3adcdc2fadb3', 'volume_name': 'volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a2caa3-2fac-409a-ac74-c45076426e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a2caa3-2fac-409a-ac74-c45076426e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70be3e4-db1f-401d-b4b8-ee4d632f951d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:17 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Volume 86497c2c-87ec-4fbb-bfed-3adcdc2fadb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3', 'volume_size': 1}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1911690289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86497c2c-87ec-4fbb-bfed-3adcdc2fadb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:18Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Creating volume 86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:17 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:17 devstack sudo[101446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 1073741824
Jul 06 21:01:17 devstack sudo[101446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:18 devstack sudo[101446]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 1073741824" returned: 0 in 1.015s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:19 devstack sudo[101465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3
Jul 06 21:01:19 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:19 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3" returned: 0 in 0.722s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] <== create_volume: return (1787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70be3e4-db1f-401d-b4b8-ee4d632f951d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d7d646-56e0-402a-b944-248bda8baa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:19 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Volume volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 (86497c2c-87ec-4fbb-bfed-3adcdc2fadb3): created successfully
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8d7d646-56e0-402a-b944-248bda8baa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:19 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (bd192ad5-6746-47d9-a1da-8f988fd91c89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:19 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c866f4ab-b725-431a-9602-37362bc01a4c tempest-VolumesActionsTest-273520518 None] Created volume successfully.
Jul 06 21:01:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Lock "cinder-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-quobyte-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:21 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc86dede-751a-441c-82f4-c33527e54ab2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-4273908e-7a7e-4a89-911f-c350cb4b3026 req-bcd51bda-3c4c-4607-bae8-4959fb563ce5 tempest-TestInstancesWithCinderVolumes-954153539 None] Terminate volume connection completed successfully.
Jul 06 21:01:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-4273908e-7a7e-4a89-911f-c350cb4b3026 req-bcd51bda-3c4c-4607-bae8-4959fb563ce5 tempest-TestInstancesWithCinderVolumes-954153539 None] Deleting attachment e35d7270-77f8-494b-b783-76d6ed5c5809. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:01:21 devstack sudo[101478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3
Jul 06 21:01:21 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:22 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3" returned: 0 in 0.846s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:22 devstack sudo[101489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3
Jul 06 21:01:22 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:22 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3" returned: 0 in 0.746s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3" released by "delete_volume" :: held 1.647s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Created reservations ['5495e7f0-35ff-4a93-a8f9-0e6f194f347e', '405e1149-0598-41a3-8b16-af9a8068240e', '6c90c172-ddbe-4aaa-a60d-3d7dcc2bcd64', '9d0f4b3c-8db3-4a01-8f00-143e52a9596c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:22 devstack sudo[101492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:22 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "cinder-a277a0c7-b3fb-45c5-93cb-4b8834696a7a-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-a277a0c7-b3fb-45c5-93cb-4b8834696a7a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "cinder-quobyte-a277a0c7-b3fb-45c5-93cb-4b8834696a7a" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-quobyte-a277a0c7-b3fb-45c5-93cb-4b8834696a7a" acquired by "delete_volume" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7436b54b-a553-4efb-a5d0-4ca1ff1e1f99]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:23 devstack sudo[101498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a
Jul 06 21:01:23 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:23 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Deleted volume successfully.
Jul 06 21:01:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5e80560a-12f8-42ff-9d2e-497e20ab6839 tempest-VolumesActionsTest-1307136058 None] Lock "cinder-86497c2c-87ec-4fbb-bfed-3adcdc2fadb3-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (545721ed-8084-46db-8380-7fc0a1e4c250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c007d4ef-ca2e-4618-819a-02eadf4e3054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c007d4ef-ca2e-4618-819a-02eadf4e3054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-274551004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd2beb2-7220-4333-84b0-b24fd0adc63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:24Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a391eb5f-dbea-4604-91ad-5bac378240e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a391eb5f-dbea-4604-91ad-5bac378240e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f92d8b-2a42-4997-9042-e08f906e33b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f92d8b-2a42-4997-9042-e08f906e33b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbd2beb2-7220-4333-84b0-b24fd0adc63c', 'volume_name': 'volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd8ea22-4bad-4519-95d2-8b5ba8f3280f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd8ea22-4bad-4519-95d2-8b5ba8f3280f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1022007-2405-443d-b50c-5fd7547e4045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:24 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Volume cbd2beb2-7220-4333-84b0-b24fd0adc63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c', 'volume_size': 1}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-274551004',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbd2beb2-7220-4333-84b0-b24fd0adc63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:24Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Creating volume cbd2beb2-7220-4333-84b0-b24fd0adc63c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:24 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:24 devstack sudo[101501]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c 1073741824
Jul 06 21:01:24 devstack sudo[101501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:24 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a" returned: 0 in 1.081s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:24 devstack sudo[101506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a
Jul 06 21:01:24 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:25 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a277a0c7-b3fb-45c5-93cb-4b8834696a7a" returned: 0 in 0.829s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-quobyte-a277a0c7-b3fb-45c5-93cb-4b8834696a7a" released by "delete_volume" :: held 1.977s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:25 devstack sudo[101501]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c 1073741824" returned: 0 in 1.140s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:25 devstack cinder-volume[86721]: WARNING cinder.quota [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1728349435-1036709014 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1728349435-1036709014, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:01:25 devstack cinder-volume[86721]: WARNING cinder.quota [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1728349435-1036709014 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1728349435-1036709014, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Created reservations ['6874df00-02fa-4d45-880a-da479e5284a9', 'a3fea369-d7bc-4c9a-8fe2-ad7cf60c3807', '81184b07-afda-4ede-a2b8-0553ef5611a7', 'f48cba0c-28c3-49f1-a68d-c69f4be0448d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:25 devstack sudo[101513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c
Jul 06 21:01:25 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:25 devstack sudo[101515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:25 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (1cd88e6c-802a-47f8-ac4b-401c7abb0462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a024a449-67ce-415a-8171-edf31aec7d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a024a449-67ce-415a-8171-edf31aec7d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1418922967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:26Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:26 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3d3141-578e-441b-87c6-60e145411d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f3d3141-578e-441b-87c6-60e145411d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0447ae9-d3de-4e29-a5c7-199710d3a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0447ae9-d3de-4e29-a5c7-199710d3a84e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20', 'volume_name': 'volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf11d75-d253-47e5-8c84-aac146814728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bf11d75-d253-47e5-8c84-aac146814728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83147b90-1355-4eb0-bcac-ce1917a2a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Volume 1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20', 'volume_size': 1}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c" returned: 0 in 0.910s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1418922967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:26Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Creating volume 1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:26 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:26 devstack sudo[101533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 1073741824
Jul 06 21:01:26 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:26 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1022007-2405-443d-b50c-5fd7547e4045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4978878b-4321-4d1e-9238-d23356757eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.888s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Deleted volume successfully.
Jul 06 21:01:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Volume volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c (cbd2beb2-7220-4333-84b0-b24fd0adc63c): created successfully
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4978878b-4321-4d1e-9238-d23356757eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (545721ed-8084-46db-8380-7fc0a1e4c250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-172e5db6-9aca-4fb2-8002-eb2bb5983a47 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-a277a0c7-b3fb-45c5-93cb-4b8834696a7a-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0cb94beb-06a8-450f-a286-976fd7831996 tempest-VolumesActionsTest-273520518 None] Created volume successfully.
Jul 06 21:01:27 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 1073741824" returned: 0 in 0.924s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:27 devstack sudo[101547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20
Jul 06 21:01:27 devstack sudo[101547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-cbd2beb2-7220-4333-84b0-b24fd0adc63c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Lock "cinder-cbd2beb2-7220-4333-84b0-b24fd0adc63c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Acquiring lock "cinder-quobyte-cbd2beb2-7220-4333-84b0-b24fd0adc63c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-cbd2beb2-7220-4333-84b0-b24fd0adc63c" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[929ceb92-a6d9-48ed-9af6-5bee05dddcf1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:27 devstack sudo[101549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c
Jul 06 21:01:27 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:27 devstack sudo[101547]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20" returned: 0 in 0.686s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.666s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83147b90-1355-4eb0-bcac-ce1917a2a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f12864-56e8-49b5-8d69-c54d165943dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:28 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Volume volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 (1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20): created successfully
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f12864-56e8-49b5-8d69-c54d165943dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (1cd88e6c-802a-47f8-ac4b-401c7abb0462) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:28 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1cafe594-8caf-400a-8023-af907a02a679 tempest-ProjectReaderTests-208552328 None] Created volume successfully.
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Lock "cinder-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:28 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-quobyte-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c" returned: 0 in 0.884s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:28 devstack sudo[101557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c
Jul 06 21:01:28 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[81110c16-2247-4091-9c8b-6667383dd677]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:28 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-628af32a-0e25-4d0e-96d6-9e7674904f56 req-dfcfe677-7143-4330-8526-45d97d182ee0 tempest-TestInstancesWithCinderVolumes-954153539 None] Terminate volume connection completed successfully.
Jul 06 21:01:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-628af32a-0e25-4d0e-96d6-9e7674904f56 req-dfcfe677-7143-4330-8526-45d97d182ee0 tempest-TestInstancesWithCinderVolumes-954153539 None] Deleting attachment e5312906-f2da-4caa-9dd6-15a0a6dbc41d. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:01:28 devstack sudo[101560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20
Jul 06 21:01:28 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:29 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cbd2beb2-7220-4333-84b0-b24fd0adc63c" returned: 0 in 0.694s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Lock "cinder-quobyte-cbd2beb2-7220-4333-84b0-b24fd0adc63c" released by "delete_volume" :: held 1.624s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Created reservations ['fef25fc5-2053-4f55-82ff-d6b538e03884', '2e4f0adc-3a03-4a5f-9cf3-8b8216b41325', '52c04e1f-3e9f-4cd7-82bc-1244adb567f3', '1cb9820f-e364-4d31-8f85-90cebe2a5a2e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:29 devstack sudo[101566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:29 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:29 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20" returned: 0 in 0.843s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:29 devstack sudo[101568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20
Jul 06 21:01:29 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:30 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.739s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Deleted volume successfully.
Jul 06 21:01:30 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f6ec64b6-d784-4563-838c-57b96cf07b2a tempest-VolumesActionsTest-1307136058 None] Lock "cinder-cbd2beb2-7220-4333-84b0-b24fd0adc63c-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20" returned: 0 in 0.726s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20" released by "delete_volume" :: held 1.623s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Created reservations ['a95f06e7-850b-4e3e-b788-4f13c617ed62', '3f2947ad-69ab-4fa0-8e08-ed215ac1c180', 'a870b699-2aee-4411-a12d-199fe63c71c0', '76b43218-2269-4fa1-b524-720d66dd60f9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:30 devstack sudo[101572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:30 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (57ed9f8c-b086-46e0-91c5-6c64be60260d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbc77e3-a860-47c4-805d-57b52b54a5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbc77e3-a860-47c4-805d-57b52b54a5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807901428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8ea348-00c9-40d6-999d-fa0946c6c07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:30Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92252911-17c0-4c65-be53-96eb870ddc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92252911-17c0-4c65-be53-96eb870ddc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d98e8b0-c544-4d08-8ad5-883f6600b996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d98e8b0-c544-4d08-8ad5-883f6600b996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d8ea348-00c9-40d6-999d-fa0946c6c07c', 'volume_name': 'volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b8863c-8c4a-4c79-9096-f75afa82a6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b8863c-8c4a-4c79-9096-f75afa82a6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd8fb4f-453a-4971-aedf-47b838bc1601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:30 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Volume 3d8ea348-00c9-40d6-999d-fa0946c6c07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c', 'volume_size': 1}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-807901428',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d8ea348-00c9-40d6-999d-fa0946c6c07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='710132e0c4e44c4d8ba9bba8a189cb70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:30Z,use_quota=True,user_id='c7a7a6c4f4bd4512ae4bec19a534ce7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Creating volume 3d8ea348-00c9-40d6-999d-fa0946c6c07c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:30 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:30 devstack sudo[101574]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c 1073741824
Jul 06 21:01:30 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "cinder-396be8d1-e221-409b-a6e5-e81da6ad49f2-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-396be8d1-e221-409b-a6e5-e81da6ad49f2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "cinder-quobyte-396be8d1-e221-409b-a6e5-e81da6ad49f2" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-quobyte-396be8d1-e221-409b-a6e5-e81da6ad49f2" acquired by "delete_volume" :: waited 0.041s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6460b607-7a4d-4ebd-85d8-f0b2469fe6f4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:30 devstack sudo[101576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2
Jul 06 21:01:30 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:31 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.894s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Deleted volume successfully.
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-545b6485-962d-4280-be95-4597e6e550de tempest-ProjectReaderTests-208552328 None] Lock "cinder-1f0c31c0-6b57-4f48-9326-7ef4eb4a0a20-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (e84bfaf7-209d-41d9-b3f4-63d98a7b1b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcde8c3-3357-4dc6-92a6-8be479dd12ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcde8c3-3357-4dc6-92a6-8be479dd12ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061779247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1c3caa-cc3f-4d81-809e-7500f2dad255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:31Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5dba91-6b38-4d7a-8465-72e76b2f13dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b5dba91-6b38-4d7a-8465-72e76b2f13dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adef8cc-2f71-4944-a4cc-d3fa8b4f5d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2adef8cc-2f71-4944-a4cc-d3fa8b4f5d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1c3caa-cc3f-4d81-809e-7500f2dad255', 'volume_name': 'volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec840ff0-a817-4af4-9b9d-34013b583cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec840ff0-a817-4af4-9b9d-34013b583cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7488f304-f7ce-4b92-9f0f-e55294b7be5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:31 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Volume 5f1c3caa-cc3f-4d81-809e-7500f2dad255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255', 'volume_size': 1}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:31 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c 1073741824" returned: 0 in 1.241s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:31 devstack sudo[101584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c
Jul 06 21:01:31 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:31 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2" returned: 0 in 1.099s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:31 devstack sudo[101587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2
Jul 06 21:01:31 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:32 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c" returned: 0 in 0.890s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] <== create_volume: return (2182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.185s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1061779247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1c3caa-cc3f-4d81-809e-7500f2dad255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:31Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Creating volume 5f1c3caa-cc3f-4d81-809e-7500f2dad255 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:32 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=87,cinder:UPDATE=110,cinder:INSERT=28,cinder:DELETE=5 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9dd8fb4f-453a-4971-aedf-47b838bc1601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:32 devstack sudo[101592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255 1073741824
Jul 06 21:01:32 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69613617-bf14-4dd0-9551-8fb2164927ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=94,cinder:INSERT=27,cinder:UPDATE=100,cinder:DELETE=11 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:01:32 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Volume volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c (3d8ea348-00c9-40d6-999d-fa0946c6c07c): created successfully
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69613617-bf14-4dd0-9551-8fb2164927ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Flow 'volume_create_manager' (57ed9f8c-b086-46e0-91c5-6c64be60260d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c45784d7-51d1-4a72-bae6-bbc04d1678ab tempest-VolumesActionsTest-273520518 None] Created volume successfully.
Jul 06 21:01:32 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-396be8d1-e221-409b-a6e5-e81da6ad49f2" returned: 0 in 0.887s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-quobyte-396be8d1-e221-409b-a6e5-e81da6ad49f2" released by "delete_volume" :: held 2.061s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:32 devstack cinder-volume[86721]: WARNING cinder.quota [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1081429232-417912242 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1081429232-417912242, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:01:32 devstack cinder-volume[86721]: WARNING cinder.quota [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1081429232-417912242 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1081429232-417912242, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Created reservations ['d172bdf8-9861-488f-a3dc-ea39410bcabe', '43658bf2-4f53-4073-b77d-b2f7fbd5e7b3', '0cd5db84-7119-48d0-acae-ea6f0ebddcac', '74f9ff62-6b9c-47cd-888b-65a81aa0b691'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:32 devstack sudo[101594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:32 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:33 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255 1073741824" returned: 0 in 1.227s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:33 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.993s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:33 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:33 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Deleted volume successfully.
Jul 06 21:01:33 devstack sudo[101602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255
Jul 06 21:01:33 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7073833d-8e32-4826-8dbc-2f47f4717c76 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-396be8d1-e221-409b-a6e5-e81da6ad49f2-delete_volume" released by "delete_volume" :: held 3.390s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Acquiring lock "cinder-3d8ea348-00c9-40d6-999d-fa0946c6c07c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Lock "cinder-3d8ea348-00c9-40d6-999d-fa0946c6c07c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Acquiring lock "cinder-quobyte-3d8ea348-00c9-40d6-999d-fa0946c6c07c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Lock "cinder-quobyte-3d8ea348-00c9-40d6-999d-fa0946c6c07c" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[96182a8b-9187-4ae6-a9dc-5b99675fc3f6]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:34 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255" returned: 0 in 0.852s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] <== create_volume: return (2153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:34 devstack sudo[101605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c
Jul 06 21:01:34 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7488f304-f7ce-4b92-9f0f-e55294b7be5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b279b3f2-1128-41f7-96f9-904383a8ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:34 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Volume volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255 (5f1c3caa-cc3f-4d81-809e-7500f2dad255): created successfully
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b279b3f2-1128-41f7-96f9-904383a8ba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (e84bfaf7-209d-41d9-b3f4-63d98a7b1b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:34 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-35021f1d-900b-496d-9f8a-feb643892bf0 tempest-ProjectReaderTests-208552328 None] Created volume successfully.
Jul 06 21:01:35 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:35 devstack sudo[101614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c
Jul 06 21:01:35 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-5f1c3caa-cc3f-4d81-809e-7500f2dad255-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Lock "cinder-5f1c3caa-cc3f-4d81-809e-7500f2dad255-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-quobyte-5f1c3caa-cc3f-4d81-809e-7500f2dad255" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-5f1c3caa-cc3f-4d81-809e-7500f2dad255" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab318873-4d8c-4284-a125-a9c7c42af1d1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:36 devstack sudo[101622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255
Jul 06 21:01:36 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:36 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3d8ea348-00c9-40d6-999d-fa0946c6c07c" returned: 0 in 0.930s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Lock "cinder-quobyte-3d8ea348-00c9-40d6-999d-fa0946c6c07c" released by "delete_volume" :: held 1.824s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Created reservations ['b5ac5dd3-bd73-4256-8f5f-94fad640af88', '48d3fc6e-25a5-4ee2-80c1-e934cd99e0b4', 'b3a3a903-185c-43e0-8756-2adb91a19bb8', '9dca1f2c-3cb0-420e-8b15-5161c391820f'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:36 devstack sudo[101636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:36 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:36 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255" returned: 0 in 1.054s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:37 devstack sudo[101643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255
Jul 06 21:01:37 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:37 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.920s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Deleted volume successfully.
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5685dbb4-5637-4d99-8a04-00c9ec0c6bb3 tempest-VolumesActionsTest-273520518 None] Lock "cinder-3d8ea348-00c9-40d6-999d-fa0946c6c07c-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:37 devstack sudo[101647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:37 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:37 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5f1c3caa-cc3f-4d81-809e-7500f2dad255" returned: 0 in 0.823s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-5f1c3caa-cc3f-4d81-809e-7500f2dad255" released by "delete_volume" :: held 1.992s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Created reservations ['0c099aa5-137b-4a35-95b0-3133c7bc2c78', '8766b1cb-5e44-4f10-926d-282344b8e1c3', '109dc2d4-8f76-4baf-9b65-afea2ab1c8e8', '0428efcb-d364-457d-bfcf-f8335075b930'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:38 devstack sudo[101651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:38 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-a8d46a6f-3b04-4675-b1c7-bdcf62037daf req-231dbf60-8c3e-4f18-8be0-c941fa546d51 tempest-TestInstancesWithCinderVolumes-954153539 None] Terminate volume connection completed successfully.
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-a8d46a6f-3b04-4675-b1c7-bdcf62037daf req-231dbf60-8c3e-4f18-8be0-c941fa546d51 tempest-TestInstancesWithCinderVolumes-954153539 None] Deleting attachment 5e217dba-e8f6-41f1-a54a-e5f53231514f. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:38 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (cba40a2e-3de3-4b6f-936b-97b1ab8aef24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3e1f45-e4a8-497e-b15e-0acdd7b3ef61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.035s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc3e1f45-e4a8-497e-b15e-0acdd7b3ef61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131739033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747e9176-0fd4-489b-a6b5-614b43a1454f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:39Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37255af2-d105-468e-a658-75c672fa081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37255af2-d105-468e-a658-75c672fa081f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf72d7df-758a-47ea-ba7d-e9ee55b6c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf72d7df-758a-47ea-ba7d-e9ee55b6c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747e9176-0fd4-489b-a6b5-614b43a1454f', 'volume_name': 'volume-747e9176-0fd4-489b-a6b5-614b43a1454f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa0737a-2804-416a-8603-700c2ba0f2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afa0737a-2804-416a-8603-700c2ba0f2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb20648c-be90-4c24-b384-3e3c4fc302c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Volume 747e9176-0fd4-489b-a6b5-614b43a1454f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747e9176-0fd4-489b-a6b5-614b43a1454f', 'volume_size': 1}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-131739033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747e9176-0fd4-489b-a6b5-614b43a1454f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:39Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Creating volume 747e9176-0fd4-489b-a6b5-614b43a1454f {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:38 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:38 devstack sudo[101655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f 1073741824
Jul 06 21:01:38 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:38 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.963s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Deleted volume successfully.
Jul 06 21:01:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-00f3b9b1-0676-4430-8b20-cdd69a9932f4 tempest-ProjectReaderTests-208552328 None] Lock "cinder-5f1c3caa-cc3f-4d81-809e-7500f2dad255-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:39 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f 1073741824" returned: 0 in 0.952s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:39 devstack sudo[101662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f
Jul 06 21:01:39 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:40 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f" returned: 0 in 0.778s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb20648c-be90-4c24-b384-3e3c4fc302c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747e9176-0fd4-489b-a6b5-614b43a1454f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3854dd19-c496-4334-8e52-0ff78ab770de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:40 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Volume volume-747e9176-0fd4-489b-a6b5-614b43a1454f (747e9176-0fd4-489b-a6b5-614b43a1454f): created successfully
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3854dd19-c496-4334-8e52-0ff78ab770de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (cba40a2e-3de3-4b6f-936b-97b1ab8aef24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f2d9c9ea-fdd8-46ec-a766-443f651b6d2e tempest-ProjectReaderTests-208552328 None] Created volume successfully.
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-747e9176-0fd4-489b-a6b5-614b43a1454f-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Lock "cinder-747e9176-0fd4-489b-a6b5-614b43a1454f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-quobyte-747e9176-0fd4-489b-a6b5-614b43a1454f" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-747e9176-0fd4-489b-a6b5-614b43a1454f" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e84d785-29d1-4344-98b4-60553b168d12]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:41 devstack sudo[101665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f
Jul 06 21:01:41 devstack sudo[101665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "cinder-9f25c31d-136d-4b4a-9088-8beb577bcbf2-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-9f25c31d-136d-4b4a-9088-8beb577bcbf2-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "cinder-quobyte-9f25c31d-136d-4b4a-9088-8beb577bcbf2" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-quobyte-9f25c31d-136d-4b4a-9088-8beb577bcbf2" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:41 devstack sudo[101665]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f" returned: 0 in 1.003s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:41 devstack sudo[101674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f
Jul 06 21:01:42 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b444a37b-bea1-44b8-9f6b-e3d9c5fe19a1]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:42 devstack sudo[101676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:01:42 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:42 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-747e9176-0fd4-489b-a6b5-614b43a1454f" returned: 0 in 0.689s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-747e9176-0fd4-489b-a6b5-614b43a1454f" released by "delete_volume" :: held 1.742s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Created reservations ['8dae6028-8236-4faa-935f-5b635495150b', 'b5f91b6b-c46f-4111-956a-d1c37b4d18a6', '62dc7f42-09f3-4be9-b460-96c32b3e93e4', '4d7553dd-dc96-4248-ad9e-983b9050aa8b'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:42 devstack sudo[101682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:42 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:42 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 0 in 0.872s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:43 devstack sudo[101684]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:01:43 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:43 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.784s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Deleted volume successfully.
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-01e14b74-9c2e-47b5-a3ec-6b95fcd297bc tempest-ProjectReaderTests-208552328 None] Lock "cinder-747e9176-0fd4-489b-a6b5-614b43a1454f-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (e5899511-1eae-4182-9c2e-5a9bad87f8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473b439-ae29-4fe5-8ee2-c478bb40900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473b439-ae29-4fe5-8ee2-c478bb40900d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540607512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4e7ac3-e927-4a23-88c2-d34ddae5c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:44Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f37f24-ffe8-4570-bb23-8700b746990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28f37f24-ffe8-4570-bb23-8700b746990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317e7095-9b2b-4aea-a348-de7343b76661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317e7095-9b2b-4aea-a348-de7343b76661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4e7ac3-e927-4a23-88c2-d34ddae5c076', 'volume_name': 'volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bcf201-f68c-4ee4-9aa4-884ef7ae5f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36bcf201-f68c-4ee4-9aa4-884ef7ae5f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66633fdd-710d-4565-9164-dc29d750d334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Volume 3f4e7ac3-e927-4a23-88c2-d34ddae5c076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076', 'volume_size': 1}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540607512',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4e7ac3-e927-4a23-88c2-d34ddae5c076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3643052c1734777a5863919a6d94e95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:44Z,use_quota=True,user_id='a3e7eb1aef4544d682fdbbe419f7713b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Creating volume 3f4e7ac3-e927-4a23-88c2-d34ddae5c076 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:43 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:43 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 1 in 0.976s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:01:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:43 devstack sudo[101691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076 1073741824
Jul 06 21:01:43 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:43 devstack sudo[101692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2
Jul 06 21:01:43 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:44 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9f25c31d-136d-4b4a-9088-8beb577bcbf2" returned: 0 in 0.735s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-quobyte-9f25c31d-136d-4b4a-9088-8beb577bcbf2" released by "delete_volume" :: held 2.705s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:44 devstack cinder-volume[86721]: WARNING cinder.quota [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-445354980-2068768863 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-445354980-2068768863, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:01:44 devstack cinder-volume[86721]: WARNING cinder.quota [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-445354980-2068768863 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-445354980-2068768863, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Created reservations ['b6e42446-8dd7-4e9d-a1f7-8d015b527ffb', '9ca1c0b4-7d6e-4167-a9a2-288a03d16e11', 'aa88e463-248a-453f-b2f0-3b89b52216d9', 'db9374e0-be5a-4f15-9ad0-6fbe1dbd47bc'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:44 devstack sudo[101700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:44 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:44 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076 1073741824" returned: 0 in 0.998s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:44 devstack sudo[101702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076
Jul 06 21:01:44 devstack sudo[101702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:45 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.884s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Deleted volume successfully.
Jul 06 21:01:45 devstack sudo[101702]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076" returned: 0 in 0.838s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] <== create_volume: return (1879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8698516-1cfa-46a5-b09f-9d4e23d11608 tempest-TestInstancesWithCinderVolumes-954153539 None] Lock "cinder-9f25c31d-136d-4b4a-9088-8beb577bcbf2-delete_volume" released by "delete_volume" :: held 3.870s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66633fdd-710d-4565-9164-dc29d750d334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79cc834-90d2-4e48-a97f-f156970e40f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Volume volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076 (3f4e7ac3-e927-4a23-88c2-d34ddae5c076): created successfully
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f79cc834-90d2-4e48-a97f-f156970e40f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Flow 'volume_create_manager' (e5899511-1eae-4182-9c2e-5a9bad87f8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ab45f68f-3adb-4b2f-96c9-c6f3164bb35d tempest-ProjectReaderTests-208552328 None] Created volume successfully.
Jul 06 21:01:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-3f4e7ac3-e927-4a23-88c2-d34ddae5c076-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Lock "cinder-3f4e7ac3-e927-4a23-88c2-d34ddae5c076-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Acquiring lock "cinder-quobyte-3f4e7ac3-e927-4a23-88c2-d34ddae5c076" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:01:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-3f4e7ac3-e927-4a23-88c2-d34ddae5c076" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:01:47 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f185d54-9c0c-47a3-8711-d880a440cbbf]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:01:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:47 devstack sudo[101707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076
Jul 06 21:01:47 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:48 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076" returned: 0 in 0.924s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:48 devstack sudo[101714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076
Jul 06 21:01:48 devstack sudo[101714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:48 devstack sudo[101714]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f4e7ac3-e927-4a23-88c2-d34ddae5c076" returned: 0 in 0.718s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Lock "cinder-quobyte-3f4e7ac3-e927-4a23-88c2-d34ddae5c076" released by "delete_volume" :: held 1.717s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Created reservations ['ee8af162-116d-4a37-96bd-27a150e4a2d5', '3f5f5980-7203-4bbf-92dc-17e2fa310001', 'ebf4b145-d82f-4d0e-af9a-49e0238734b8', '869cd9f3-8707-4cc5-bdb7-d871da7141b5'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:48 devstack sudo[101717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:01:48 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:49 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.923s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:49 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:01:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Deleted volume successfully.
Jul 06 21:01:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a056f4e-f3ca-4d74-b295-50599b062470 tempest-ProjectReaderTests-208552328 None] Lock "cinder-3f4e7ac3-e927-4a23-88c2-d34ddae5c076-delete_volume" released by "delete_volume" :: held 2.905s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Flow 'volume_create_manager' (7fb99a0c-0d84-47d8-8455-518c013feb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d804638-7c69-4855-a3c5-603afce48fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d804638-7c69-4855-a3c5-603afce48fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2111166293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9240f522-5dd3-4696-8871-aa33bbc09b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c9e76af51f4c30823971496f8ebcc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:52Z,use_quota=True,user_id='096aca8852c744c684e9776048b9c2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bd6c72-3767-4ed5-80a7-066d8086e5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bd6c72-3767-4ed5-80a7-066d8086e5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de05e86-1fc1-4e8b-b630-f4bebbecbb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8de05e86-1fc1-4e8b-b630-f4bebbecbb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9240f522-5dd3-4696-8871-aa33bbc09b94', 'volume_name': 'volume-9240f522-5dd3-4696-8871-aa33bbc09b94', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a39ce9d-d984-488c-908a-fe24c91b523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a39ce9d-d984-488c-908a-fe24c91b523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1e54af-971c-49ec-a7f2-281e5d9ca12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Volume 9240f522-5dd3-4696-8871-aa33bbc09b94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9240f522-5dd3-4696-8871-aa33bbc09b94', 'volume_size': 1}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2111166293',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9240f522-5dd3-4696-8871-aa33bbc09b94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c9e76af51f4c30823971496f8ebcc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:52Z,use_quota=True,user_id='096aca8852c744c684e9776048b9c2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Creating volume 9240f522-5dd3-4696-8871-aa33bbc09b94 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:51 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:51 devstack sudo[101721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94 1073741824
Jul 06 21:01:51 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:52 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94 1073741824" returned: 0 in 0.908s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:52 devstack sudo[101728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94
Jul 06 21:01:52 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:53 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94" returned: 0 in 0.724s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d1e54af-971c-49ec-a7f2-281e5d9ca12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9240f522-5dd3-4696-8871-aa33bbc09b94', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547afb55-f9ec-47af-ae53-a94c09352307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Volume volume-9240f522-5dd3-4696-8871-aa33bbc09b94 (9240f522-5dd3-4696-8871-aa33bbc09b94): created successfully
Jul 06 21:01:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (547afb55-f9ec-47af-ae53-a94c09352307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Flow 'volume_create_manager' (7fb99a0c-0d84-47d8-8455-518c013feb96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bd4133d4-7844-4ae5-9e62-3f125e69a30f tempest-VolumesListAdminTestJSON-380398005 None] Created volume successfully.
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Flow 'volume_create_manager' (43d442ea-e882-4812-9053-148688545cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc74cd-e897-4bff-ae0d-b96063d4d4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbc74cd-e897-4bff-ae0d-b96063d4d4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-737126451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9e57fc-06c0-4645-a4b0-baf1e999c4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c9e76af51f4c30823971496f8ebcc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:54Z,use_quota=True,user_id='096aca8852c744c684e9776048b9c2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1a1517-630e-4561-913a-6e9358f16d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e1a1517-630e-4561-913a-6e9358f16d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3124d5d-5567-4077-89e4-918c03627d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3124d5d-5567-4077-89e4-918c03627d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba9e57fc-06c0-4645-a4b0-baf1e999c4c5', 'volume_name': 'volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a43935-8123-49b5-a974-d5ac33a11f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5a43935-8123-49b5-a974-d5ac33a11f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82e5d2c-ae61-42da-a229-634e0c09a916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:54 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Volume ba9e57fc-06c0-4645-a4b0-baf1e999c4c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5', 'volume_size': 1}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-737126451',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba9e57fc-06c0-4645-a4b0-baf1e999c4c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c9e76af51f4c30823971496f8ebcc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:54Z,use_quota=True,user_id='096aca8852c744c684e9776048b9c2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Creating volume ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:54 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:54 devstack sudo[101732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 1073741824
Jul 06 21:01:54 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:55 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 1073741824" returned: 0 in 0.918s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:55 devstack sudo[101738]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5
Jul 06 21:01:55 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:56 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5" returned: 0 in 0.767s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a82e5d2c-ae61-42da-a229-634e0c09a916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975799c5-6c3a-4d38-86e0-14b628fdb3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:56 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Volume volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 (ba9e57fc-06c0-4645-a4b0-baf1e999c4c5): created successfully
Jul 06 21:01:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975799c5-6c3a-4d38-86e0-14b628fdb3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Flow 'volume_create_manager' (43d442ea-e882-4812-9053-148688545cc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-31c3993b-516f-4072-be4d-1ffa8c7f17ea tempest-VolumesListAdminTestJSON-380398005 None] Created volume successfully.
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Flow 'volume_create_manager' (994d9b56-362c-40c0-addf-17b4fc424684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f984f4e0-1081-4b3e-94e8-111df7f8a0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f984f4e0-1081-4b3e-94e8-111df7f8a0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-780015493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10792072-0b37-4e48-83d3-847587f37200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c9e76af51f4c30823971496f8ebcc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:57Z,use_quota=True,user_id='096aca8852c744c684e9776048b9c2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f3d5d0-33d2-47c0-9220-68037fa9e251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f3d5d0-33d2-47c0-9220-68037fa9e251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095959a7-1cb9-4db4-91d4-6468fd8e6faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095959a7-1cb9-4db4-91d4-6468fd8e6faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10792072-0b37-4e48-83d3-847587f37200', 'volume_name': 'volume-10792072-0b37-4e48-83d3-847587f37200', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47a2c11-d6d5-4d6e-87c0-6feafde861ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47a2c11-d6d5-4d6e-87c0-6feafde861ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715f1319-d5eb-4fef-ab66-7ec3e7ce650e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:57 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Volume 10792072-0b37-4e48-83d3-847587f37200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10792072-0b37-4e48-83d3-847587f37200', 'volume_size': 1}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-780015493',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10792072-0b37-4e48-83d3-847587f37200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93c9e76af51f4c30823971496f8ebcc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:01:57Z,use_quota=True,user_id='096aca8852c744c684e9776048b9c2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Creating volume 10792072-0b37-4e48-83d3-847587f37200 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:01:57 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:01:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:57 devstack sudo[101742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200 1073741824
Jul 06 21:01:57 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:58 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200 1073741824" returned: 0 in 0.984s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:01:58 devstack sudo[101749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200
Jul 06 21:01:58 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:01:59 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root
Jul 06 21:01:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200" returned: 0 in 0.756s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:01:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:01:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:01:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (715f1319-d5eb-4fef-ab66-7ec3e7ce650e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10792072-0b37-4e48-83d3-847587f37200', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258cfda8-66d5-44af-b32a-71ebc42b2f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:01:59 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Volume volume-10792072-0b37-4e48-83d3-847587f37200 (10792072-0b37-4e48-83d3-847587f37200): created successfully
Jul 06 21:01:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (258cfda8-66d5-44af-b32a-71ebc42b2f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:01:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Flow 'volume_create_manager' (994d9b56-362c-40c0-addf-17b4fc424684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:01:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a76a0403-9f90-483f-8f40-3e67fecac6dd tempest-VolumesListAdminTestJSON-380398005 None] Created volume successfully.
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Flow 'volume_create_manager' (7d0960cd-5599-473d-85ea-d15b3d242b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29c18d2-f07f-4f05-baea-d40cbb6ced40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29c18d2-f07f-4f05-baea-d40cbb6ced40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba36fd96-1573-404e-a244-a15027bcb665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee372f60d6b4fb68ce4490e7229264f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:01Z,use_quota=True,user_id='57dde084fe9b40dd907e979f542c7d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da78480f-c2f8-444a-bf51-2048251c9b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da78480f-c2f8-444a-bf51-2048251c9b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad520e76-7bdb-47a9-95e0-dacff75149b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad520e76-7bdb-47a9-95e0-dacff75149b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba36fd96-1573-404e-a244-a15027bcb665', 'volume_name': 'volume-ba36fd96-1573-404e-a244-a15027bcb665', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ed54f8-fb8b-4cef-afb6-9b9428129252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ed54f8-fb8b-4cef-afb6-9b9428129252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cef9df4-4eea-434e-9f70-40bca324e525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:01 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Volume ba36fd96-1573-404e-a244-a15027bcb665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba36fd96-1573-404e-a244-a15027bcb665', 'volume_size': 1}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba36fd96-1573-404e-a244-a15027bcb665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ee372f60d6b4fb68ce4490e7229264f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:01Z,use_quota=True,user_id='57dde084fe9b40dd907e979f542c7d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Creating volume ba36fd96-1573-404e-a244-a15027bcb665 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:02:01 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:02:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:01 devstack sudo[101752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665 1073741824
Jul 06 21:02:01 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:02 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665 1073741824" returned: 0 in 1.075s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:02 devstack sudo[101758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665
Jul 06 21:02:02 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:03 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665" returned: 0 in 0.693s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] <== create_volume: return (1815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.818s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cef9df4-4eea-434e-9f70-40bca324e525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba36fd96-1573-404e-a244-a15027bcb665', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3421d88-7343-4a49-a741-eaaf2efbefe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:03 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Volume volume-ba36fd96-1573-404e-a244-a15027bcb665 (ba36fd96-1573-404e-a244-a15027bcb665): created successfully
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3421d88-7343-4a49-a741-eaaf2efbefe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Flow 'volume_create_manager' (7d0960cd-5599-473d-85ea-d15b3d242b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1d931afe-14ca-4111-8475-19af8721fa3b tempest-VolumesListAdminTestJSON-1122077633 None] Created volume successfully.
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Acquiring lock "cinder-ba36fd96-1573-404e-a244-a15027bcb665-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Lock "cinder-ba36fd96-1573-404e-a244-a15027bcb665-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Acquiring lock "cinder-quobyte-ba36fd96-1573-404e-a244-a15027bcb665" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Lock "cinder-quobyte-ba36fd96-1573-404e-a244-a15027bcb665" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[df10db34-1f88-407b-8aca-90a63d8bac82]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "cinder-10792072-0b37-4e48-83d3-847587f37200-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-10792072-0b37-4e48-83d3-847587f37200-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "cinder-quobyte-10792072-0b37-4e48-83d3-847587f37200" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-quobyte-10792072-0b37-4e48-83d3-847587f37200" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:03 devstack sudo[101761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665
Jul 06 21:02:03 devstack sudo[101761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[217b9637-2f70-4e6b-aa42-723ef313f35a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:03 devstack sudo[101763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200
Jul 06 21:02:03 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:04 devstack sudo[101761]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665" returned: 0 in 0.943s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:04 devstack sudo[101768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665
Jul 06 21:02:04 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:04 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200" returned: 0 in 0.965s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:04 devstack sudo[101773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200
Jul 06 21:02:04 devstack sudo[101773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:05 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba36fd96-1573-404e-a244-a15027bcb665" returned: 0 in 0.796s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Lock "cinder-quobyte-ba36fd96-1573-404e-a244-a15027bcb665" released by "delete_volume" :: held 1.800s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Created reservations ['3897374f-4751-40bf-b67a-5117cef99e6b', '6531fb7d-935f-4a34-9bfb-c525c023893b', 'da0341d2-b90e-4f2b-ad29-21b859ba2316', '066db7a9-8de6-4c74-a872-f97a53721c53'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:02:05 devstack sudo[101773]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-10792072-0b37-4e48-83d3-847587f37200" returned: 0 in 0.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-quobyte-10792072-0b37-4e48-83d3-847587f37200" released by "delete_volume" :: held 1.752s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:05 devstack sudo[101777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:05 devstack sudo[101777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Created reservations ['0122965d-1868-4eb0-acbf-a5c8e174d100', 'bed95ae0-6e97-48d4-baa1-e5151dfb1e5c', '90ad19dc-bd96-409e-a313-c825d8da7bdc', 'd5d64638-2c6a-4d15-a167-ecfd42d64ed5'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:05 devstack sudo[101779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:05 devstack sudo[101779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "cinder-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "cinder-quobyte-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-quobyte-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f513db3-61cb-4b16-a6c3-91bd7f9127cf]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:06 devstack sudo[101781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5
Jul 06 21:02:06 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:06 devstack sudo[101777]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:02:06 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Deleted volume successfully.
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8474cb62-3373-4aa0-8ee3-9a245cfc3fd1 tempest-VolumesListAdminTestJSON-1122077633 None] Lock "cinder-ba36fd96-1573-404e-a244-a15027bcb665-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:06 devstack sudo[101779]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.894s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:02:06 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Deleted volume successfully.
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49d714d5-b5f7-412c-8364-2ef1307e5f53 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-10792072-0b37-4e48-83d3-847587f37200-delete_volume" released by "delete_volume" :: held 2.996s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:06 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5" returned: 0 in 0.912s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:07 devstack sudo[101788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5
Jul 06 21:02:07 devstack sudo[101788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:07 devstack sudo[101788]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5" returned: 0 in 0.814s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-quobyte-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5" released by "delete_volume" :: held 1.793s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Created reservations ['a0149eb6-3b6b-48a1-91aa-49847f34464d', '46ef161b-4ea8-4b03-b33a-152d213ded40', '1c2b5283-4326-4e10-a5e4-9372c4cfddfb', '920daf90-eb67-4663-856d-f8ade3403dad'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:07 devstack sudo[101793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:07 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "cinder-9240f522-5dd3-4696-8871-aa33bbc09b94-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-9240f522-5dd3-4696-8871-aa33bbc09b94-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "cinder-quobyte-9240f522-5dd3-4696-8871-aa33bbc09b94" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-quobyte-9240f522-5dd3-4696-8871-aa33bbc09b94" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1234b2e-dc6f-4d80-b7f2-f08acc0277c2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:08 devstack sudo[101795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94
Jul 06 21:02:08 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:08 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.751s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:02:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Deleted volume successfully.
Jul 06 21:02:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6a5df13e-33aa-4e62-bddb-c15dda1dde34 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-ba9e57fc-06c0-4645-a4b0-baf1e999c4c5-delete_volume" released by "delete_volume" :: held 2.785s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:09 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94" returned: 0 in 0.836s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:09 devstack sudo[101801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94
Jul 06 21:02:09 devstack sudo[101801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:09 devstack sudo[101801]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9240f522-5dd3-4696-8871-aa33bbc09b94" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-quobyte-9240f522-5dd3-4696-8871-aa33bbc09b94" released by "delete_volume" :: held 1.566s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Created reservations ['326bed8a-7a6e-4dbd-9aec-715642a87625', 'ba2700fa-9831-41a8-a20d-f18225e20e00', '9b121feb-7598-4647-94b9-19a22704223f', 'c80d78f9-8ab9-4ccd-9de9-ed74e2e73932'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:10 devstack sudo[101804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:10 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:10 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.800s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:02:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Deleted volume successfully.
Jul 06 21:02:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ac7e0bb7-0699-4026-a0bc-a83218ca5c08 tempest-VolumesListAdminTestJSON-380398005 None] Lock "cinder-9240f522-5dd3-4696-8871-aa33bbc09b94-delete_volume" released by "delete_volume" :: held 2.631s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Flow 'volume_create_manager' (0af379f2-c598-49f8-81c7-a0a32bd65d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61872c71-f888-4151-830d-db342ed5dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61872c71-f888-4151-830d-db342ed5dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2027257157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7052c00c-f23f-4828-9c4a-951d84a42a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bebfddc05e4e7a97bab5e7f3cbc70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:18Z,use_quota=True,user_id='b205b408699742f4bcfc9415738eb37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c378c34d-7db4-4d6b-a56e-03210237927f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c378c34d-7db4-4d6b-a56e-03210237927f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4910d-990e-4a13-8d71-fc4aac979fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d4910d-990e-4a13-8d71-fc4aac979fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7052c00c-f23f-4828-9c4a-951d84a42a87', 'volume_name': 'volume-7052c00c-f23f-4828-9c4a-951d84a42a87', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713debf52a80>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3353217-4df3-4740-99cf-69017dbe8d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3353217-4df3-4740-99cf-69017dbe8d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2170b77c-1e38-4ad8-a8e1-492618e3aabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:18 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Volume 7052c00c-f23f-4828-9c4a-951d84a42a87: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7052c00c-f23f-4828-9c4a-951d84a42a87', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713debf52a80>}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Trying to clone 7052c00c-f23f-4828-9c4a-951d84a42a87 from image 0acbb0cd-0336-492a-b73d-b152eae4e946 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 21:02:18 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Image download 20.69 MB at 20.69 MB/s
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93cf001-9bbf-4442-99a9-74234d47785c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:18 devstack sudo[101847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD
Jul 06 21:02:18 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:19 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:19 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 is fetched for user b205b408699742f4bcfc9415738eb37a. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 21:02:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a9a825-4f3b-4e2e-9190-da7bc2b01ad3]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:19 devstack sudo[101852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD
Jul 06 21:02:19 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:20 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD" returned: 0 in 0.750s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2027257157',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7052c00c-f23f-4828-9c4a-951d84a42a87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5bebfddc05e4e7a97bab5e7f3cbc70e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:18Z,use_quota=True,user_id='b205b408699742f4bcfc9415738eb37a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Creating volume 7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:02:20 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:02:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:20 devstack sudo[101857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 1073741824
Jul 06 21:02:20 devstack sudo[101857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:21 devstack sudo[101857]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 1073741824" returned: 0 in 0.883s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:21 devstack sudo[101863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87
Jul 06 21:02:21 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:21 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87" returned: 0 in 0.651s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:02:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:21 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Attempting download of 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume 7052c00c-f23f-4828-9c4a-951d84a42a87. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 21:02:22 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e23a4-67a3-4308-b5a4-85270c2750c0]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_1fu85362 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:22 devstack sudo[101872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_1fu85362
Jul 06 21:02:22 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:22 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_1fu85362" returned: 0 in 0.744s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_1fu85362 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:22 devstack sudo[101879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_1fu85362
Jul 06 21:02:22 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:23 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_1fu85362" returned: 1 in 0.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0acbb0cd-0336-492a-b73d-b152eae4e946_1fu85362' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:02:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea62602-c182-49b3-86a7-7e224d024c85]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:23 devstack sudo[101883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD
Jul 06 21:02:23 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:24 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:24 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] 0acbb0cd-0336-492a-b73d-b152eae4e946 was qcow2, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 21:02:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:24 devstack sudo[101888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87
Jul 06 21:02:24 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:26 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87" returned: 0 in 1.916s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:26 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0acbb0cd-0336-492a-b73d-b152eae4e946_ibe0vkx7devstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:02:26 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Converted 112.00 MB image at 58.41 MB/s
Jul 06 21:02:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:26 devstack sudo[101898]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 1G
Jul 06 21:02:26 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:26 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 1G" returned: 0 in 0.674s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:26 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fd9fe4-7033-4724-b6ba-00c28f074c48]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:26 devstack sudo[101903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87
Jul 06 21:02:26 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:27 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87" returned: 0 in 0.761s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:27 devstack sudo[101907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87
Jul 06 21:02:27 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:28 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87" returned: 1 in 0.805s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Downloaded image 0acbb0cd-0336-492a-b73d-b152eae4e946 ((None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}])) to volume 7052c00c-f23f-4828-9c4a-951d84a42a87 successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Temporary image 0acbb0cd-0336-492a-b73d-b152eae4e946 for user b205b408699742f4bcfc9415738eb37a is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Marking volume 7052c00c-f23f-4828-9c4a-951d84a42a87 as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Copying metadata from image 0acbb0cd-0336-492a-b73d-b152eae4e946 to 7052c00c-f23f-4828-9c4a-951d84a42a87. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Creating volume glance metadata for volume 7052c00c-f23f-4828-9c4a-951d84a42a87 backed by image 0acbb0cd-0336-492a-b73d-b152eae4e946 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2170b77c-1e38-4ad8-a8e1-492618e3aabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7052c00c-f23f-4828-9c4a-951d84a42a87', 'volume_size': 1, 'image_id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0acbb0cd-0336-492a-b73d-b152eae4e946', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'edb0e4c0cec447a987d4c39eedbe77a8', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0acbb0cd-0336-492a-b73d-b152eae4e946', 'created_at': datetime.datetime(2026, 7, 6, 18, 38, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 38, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0acbb0cd-0336-492a-b73d-b152eae4e946/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713debf52a80>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179c8e0d-45bc-4984-b75b-4976b2b0a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:28 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Volume volume-7052c00c-f23f-4828-9c4a-951d84a42a87 (7052c00c-f23f-4828-9c4a-951d84a42a87): created successfully
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (179c8e0d-45bc-4984-b75b-4976b2b0a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Flow 'volume_create_manager' (0af379f2-c598-49f8-81c7-a0a32bd65d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:28 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6e85c7dd-3c8b-4478-8a7a-7afacb75b0e0 tempest-VolumesImageMetadata-2048516542 None] Created volume successfully.
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Acquiring lock "cinder-7052c00c-f23f-4828-9c4a-951d84a42a87-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Lock "cinder-7052c00c-f23f-4828-9c4a-951d84a42a87-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Acquiring lock "cinder-quobyte-7052c00c-f23f-4828-9c4a-951d84a42a87" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Lock "cinder-quobyte-7052c00c-f23f-4828-9c4a-951d84a42a87" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cfe430-fa64-4463-8282-154e5d19a801]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:29 devstack sudo[101918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87
Jul 06 21:02:29 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:29 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87" returned: 0 in 0.813s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:30 devstack sudo[101934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87
Jul 06 21:02:30 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:30 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87" returned: 1 in 0.769s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:02:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:30 devstack sudo[101939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87
Jul 06 21:02:30 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:31 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7052c00c-f23f-4828-9c4a-951d84a42a87" returned: 0 in 0.654s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Lock "cinder-quobyte-7052c00c-f23f-4828-9c4a-951d84a42a87" released by "delete_volume" :: held 2.297s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Created reservations ['29aba1ff-73d2-4167-8706-ecb62d5e6287', 'e80591f3-e439-402d-9155-1b0d82d3de4d', '5b5c1f8e-46fc-401e-a281-9eb17114f54d', '42e107db-d37f-4c86-802d-9d1c0d775f40'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:31 devstack sudo[101942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:31 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:32 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.739s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:32 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:02:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Deleted volume successfully.
Jul 06 21:02:32 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a013bae3-4397-4019-8645-0513380b3824 tempest-VolumesImageMetadata-2048516542 None] Lock "cinder-7052c00c-f23f-4828-9c4a-951d84a42a87-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=119,cinder:DELETE=11,cinder:SELECT=75,cinder:INSERT=26 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=81,cinder:INSERT=39,cinder:UPDATE=108,cinder:DELETE=9 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Flow 'volume_create_manager' (a8dc3386-f842-430d-8b82-3fe6c55c4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd1b084-282e-4e6f-8916-de99bdcfecbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dd1b084-282e-4e6f-8916-de99bdcfecbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1234102895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc185e3a-d85a-4bc6-8a74-6a03638a408f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4ccb588cbf45e59236e3f78cbcaef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:36Z,use_quota=True,user_id='bfe3e32ab4f04c7f96136ae47fac591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78946ca6-7c7d-4680-be1b-cde8e9530b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78946ca6-7c7d-4680-be1b-cde8e9530b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96ffa0f-5004-4071-b36f-5cd8fb9c1f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96ffa0f-5004-4071-b36f-5cd8fb9c1f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc185e3a-d85a-4bc6-8a74-6a03638a408f', 'volume_name': 'volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c4bdd9-e583-4a10-8d3b-0c6a7e37b1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69c4bdd9-e583-4a10-8d3b-0c6a7e37b1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60368123-f48f-4fe6-957b-2092b8b62704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:36 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Volume dc185e3a-d85a-4bc6-8a74-6a03638a408f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f', 'volume_size': 1}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1234102895',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc185e3a-d85a-4bc6-8a74-6a03638a408f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca4ccb588cbf45e59236e3f78cbcaef4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:36Z,use_quota=True,user_id='bfe3e32ab4f04c7f96136ae47fac591d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Creating volume dc185e3a-d85a-4bc6-8a74-6a03638a408f {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:02:36 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:02:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:36 devstack sudo[102014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f 1073741824
Jul 06 21:02:36 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:37 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f 1073741824" returned: 0 in 1.000s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:37 devstack sudo[102020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f
Jul 06 21:02:37 devstack sudo[102020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:37 devstack sudo[102021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:37 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:38 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.760s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:02:38 devstack sudo[102020]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f" returned: 0 in 0.830s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.883s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60368123-f48f-4fe6-957b-2092b8b62704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7503fcba-1547-4250-9844-3b88708e3967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Volume volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f (dc185e3a-d85a-4bc6-8a74-6a03638a408f): created successfully
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7503fcba-1547-4250-9844-3b88708e3967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Flow 'volume_create_manager' (a8dc3386-f842-430d-8b82-3fe6c55c4776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-53b68fd8-b3f4-4cdf-aa3f-9c7462d66abd tempest-AbsoluteLimitsTests-25466176 None] Created volume successfully.
Jul 06 21:02:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Acquiring lock "cinder-dc185e3a-d85a-4bc6-8a74-6a03638a408f-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Lock "cinder-dc185e3a-d85a-4bc6-8a74-6a03638a408f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Acquiring lock "cinder-quobyte-dc185e3a-d85a-4bc6-8a74-6a03638a408f" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Lock "cinder-quobyte-dc185e3a-d85a-4bc6-8a74-6a03638a408f" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ebdaf2-072b-4a8e-81ff-e9c871147164]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:40 devstack sudo[102030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f
Jul 06 21:02:40 devstack sudo[102030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:40 devstack sudo[102030]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f" returned: 0 in 0.784s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:40 devstack sudo[102035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f
Jul 06 21:02:40 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:41 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-dc185e3a-d85a-4bc6-8a74-6a03638a408f" returned: 0 in 0.630s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Lock "cinder-quobyte-dc185e3a-d85a-4bc6-8a74-6a03638a408f" released by "delete_volume" :: held 1.456s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Created reservations ['1f410538-5a4e-44d7-aa26-338d43789e29', '19f212af-32ba-41c8-9fc2-23c79ed1cf52', '7209ea35-60b3-43c4-b442-c17399e14602', 'c294d2c5-32f9-4c9f-93e9-4311f6c914a0'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:41 devstack sudo[102040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:41 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:42 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.672s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:42 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:02:42 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Deleted volume successfully.
Jul 06 21:02:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-34e304bb-3beb-4de6-b041-558563b7c136 tempest-AbsoluteLimitsTests-25466176 None] Lock "cinder-dc185e3a-d85a-4bc6-8a74-6a03638a408f-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Flow 'volume_create_manager' (630b012f-47e7-40a7-a046-9d5858db8557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d51836d-5b54-4df3-8066-15badc60a3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d51836d-5b54-4df3-8066-15badc60a3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1218293883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4a2f6c0fd73445289730112baaf5c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:48Z,use_quota=True,user_id='ab2d9a6968684d779526a8ca8dde6de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ce1c7e-4b57-450a-a2bf-4a9785ed555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22ce1c7e-4b57-450a-a2bf-4a9785ed555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fd9abb-4413-4a7a-8c1a-32718745891a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19fd9abb-4413-4a7a-8c1a-32718745891a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301', 'volume_name': 'volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef38a21-c96a-4579-8551-37c841820830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef38a21-c96a-4579-8551-37c841820830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1435352-5673-4168-854b-a606513821b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:48 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Volume a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301', 'volume_size': 1}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1218293883',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4a2f6c0fd73445289730112baaf5c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:48Z,use_quota=True,user_id='ab2d9a6968684d779526a8ca8dde6de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Creating volume a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:02:48 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:02:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:48 devstack sudo[102061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 1073741824
Jul 06 21:02:48 devstack sudo[102061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:49 devstack sudo[102061]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 1073741824" returned: 0 in 0.815s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:49 devstack sudo[102067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301
Jul 06 21:02:49 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:49 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301" returned: 0 in 0.645s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1435352-5673-4168-854b-a606513821b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e6b857-d006-43e8-a3e7-5c4099a3a315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Volume volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 (a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301): created successfully
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e6b857-d006-43e8-a3e7-5c4099a3a315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Flow 'volume_create_manager' (630b012f-47e7-40a7-a046-9d5858db8557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:50 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-091039b1-f0e5-4978-8474-736162365362 tempest-VolumesListTestJSON-277798741 None] Created volume successfully.
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Flow 'volume_create_manager' (720f166f-5c1e-4303-bf75-741d48775d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6892325f-c7ab-4a63-80aa-21ddb966af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6892325f-c7ab-4a63-80aa-21ddb966af6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-301990759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87179588-c45d-40d4-b9a2-d829cf3fec2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4a2f6c0fd73445289730112baaf5c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:51Z,use_quota=True,user_id='ab2d9a6968684d779526a8ca8dde6de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b236d7-8e4e-4aa6-937b-459852064326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34b236d7-8e4e-4aa6-937b-459852064326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19d0f7a-71bd-4847-9483-9b566f211896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19d0f7a-71bd-4847-9483-9b566f211896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87179588-c45d-40d4-b9a2-d829cf3fec2c', 'volume_name': 'volume-87179588-c45d-40d4-b9a2-d829cf3fec2c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26be8f79-4169-4ac0-86c9-11a35309f17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26be8f79-4169-4ac0-86c9-11a35309f17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb8d07d-2a2f-4fdc-a15f-d63725e78870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Volume 87179588-c45d-40d4-b9a2-d829cf3fec2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87179588-c45d-40d4-b9a2-d829cf3fec2c', 'volume_size': 1}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-301990759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87179588-c45d-40d4-b9a2-d829cf3fec2c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4a2f6c0fd73445289730112baaf5c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:51Z,use_quota=True,user_id='ab2d9a6968684d779526a8ca8dde6de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Creating volume 87179588-c45d-40d4-b9a2-d829cf3fec2c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:02:51 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:51 devstack sudo[102070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c 1073741824
Jul 06 21:02:51 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:51 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c 1073741824" returned: 0 in 0.802s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:51 devstack sudo[102076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c
Jul 06 21:02:51 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:52 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c" returned: 0 in 0.646s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:02:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acb8d07d-2a2f-4fdc-a15f-d63725e78870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87179588-c45d-40d4-b9a2-d829cf3fec2c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd6da41-1eb4-4e97-9945-4a0ce4f039a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:52 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Volume volume-87179588-c45d-40d4-b9a2-d829cf3fec2c (87179588-c45d-40d4-b9a2-d829cf3fec2c): created successfully
Jul 06 21:02:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccd6da41-1eb4-4e97-9945-4a0ce4f039a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Flow 'volume_create_manager' (720f166f-5c1e-4303-bf75-741d48775d1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ab5a8dea-14b9-4143-a621-e33cff498ba1 tempest-VolumesListTestJSON-277798741 None] Created volume successfully.
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Flow 'volume_create_manager' (be187fdd-df95-4045-af9d-0778745162a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d337b2f-fd68-4149-a7fc-c865e2db2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d337b2f-fd68-4149-a7fc-c865e2db2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1376218227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d8e826-d231-4826-9bf3-4d8d02d31580,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4a2f6c0fd73445289730112baaf5c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:54Z,use_quota=True,user_id='ab2d9a6968684d779526a8ca8dde6de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8bf35a-67e9-4848-959e-3e9695e9e5b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b8bf35a-67e9-4848-959e-3e9695e9e5b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca290068-502e-4931-beee-9d19ee119117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca290068-502e-4931-beee-9d19ee119117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d8e826-d231-4826-9bf3-4d8d02d31580', 'volume_name': 'volume-65d8e826-d231-4826-9bf3-4d8d02d31580', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f67e533-7e15-46de-af27-a37bc59f69af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f67e533-7e15-46de-af27-a37bc59f69af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ed24f0-7adc-4bb7-9621-a16a272c1fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Volume 65d8e826-d231-4826-9bf3-4d8d02d31580: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d8e826-d231-4826-9bf3-4d8d02d31580', 'volume_size': 1}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1376218227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d8e826-d231-4826-9bf3-4d8d02d31580,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b4a2f6c0fd73445289730112baaf5c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:54Z,use_quota=True,user_id='ab2d9a6968684d779526a8ca8dde6de2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Creating volume 65d8e826-d231-4826-9bf3-4d8d02d31580 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:02:53 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:02:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:53 devstack sudo[102079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580 1073741824
Jul 06 21:02:53 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:54 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580 1073741824" returned: 0 in 0.831s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:54 devstack sudo[102085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580
Jul 06 21:02:54 devstack sudo[102085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:55 devstack sudo[102085]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580" returned: 0 in 0.629s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:02:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38ed24f0-7adc-4bb7-9621-a16a272c1fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d8e826-d231-4826-9bf3-4d8d02d31580', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a514ed46-a068-42a0-94fb-ebfb056bb1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Volume volume-65d8e826-d231-4826-9bf3-4d8d02d31580 (65d8e826-d231-4826-9bf3-4d8d02d31580): created successfully
Jul 06 21:02:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a514ed46-a068-42a0-94fb-ebfb056bb1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Flow 'volume_create_manager' (be187fdd-df95-4045-af9d-0778745162a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5236f007-e10b-4acf-8e97-f46ccaa5ae4b tempest-VolumesListTestJSON-277798741 None] Created volume successfully.
Jul 06 21:02:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Acquiring lock "cinder-65d8e826-d231-4826-9bf3-4d8d02d31580-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Lock "cinder-65d8e826-d231-4826-9bf3-4d8d02d31580-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Acquiring lock "cinder-quobyte-65d8e826-d231-4826-9bf3-4d8d02d31580" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:02:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Lock "cinder-quobyte-65d8e826-d231-4826-9bf3-4d8d02d31580" acquired by "delete_volume" :: waited 0.013s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:02:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a719829-86a3-4caa-88bb-c93dd02b0004]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:02:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:57 devstack sudo[102089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580
Jul 06 21:02:57 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:58 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580" returned: 0 in 0.771s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:58 devstack sudo[102097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580
Jul 06 21:02:58 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Flow 'volume_create_manager' (7875c924-c391-484a-aed3-4506886f006e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d29addb-f0e0-4be4-9791-27d84dfebf01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d29addb-f0e0-4be4-9791-27d84dfebf01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1994166664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5a409-a672-4f0d-92e4-a97480382f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ad3000a9e340beab10951032354a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:59Z,use_quota=True,user_id='471f7b3459dd4f928fddcdd88b28dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6ee20c-a1c9-443e-b8bd-913e85bd12ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f6ee20c-a1c9-443e-b8bd-913e85bd12ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f811324-ba23-4fdb-9d43-951ac6b03f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f811324-ba23-4fdb-9d43-951ac6b03f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cef5a409-a672-4f0d-92e4-a97480382f84', 'volume_name': 'volume-cef5a409-a672-4f0d-92e4-a97480382f84', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92026d0-8fb3-455d-abf9-a3fa1208eca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d92026d0-8fb3-455d-abf9-a3fa1208eca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372f0084-e681-4716-9b86-b66db0ed836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:02:59 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Volume cef5a409-a672-4f0d-92e4-a97480382f84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cef5a409-a672-4f0d-92e4-a97480382f84', 'volume_size': 1}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1994166664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cef5a409-a672-4f0d-92e4-a97480382f84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0ad3000a9e340beab10951032354a75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:02:59Z,use_quota=True,user_id='471f7b3459dd4f928fddcdd88b28dd05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Creating volume cef5a409-a672-4f0d-92e4-a97480382f84 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:02:59 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:59 devstack sudo[102099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84 1073741824
Jul 06 21:02:59 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:59 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-65d8e826-d231-4826-9bf3-4d8d02d31580" returned: 0 in 0.726s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Lock "cinder-quobyte-65d8e826-d231-4826-9bf3-4d8d02d31580" released by "delete_volume" :: held 1.546s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Created reservations ['093691b6-80ce-4e6b-ad1f-5b8c08483bfb', '9c2c635b-0404-463d-b6dc-e525e0d0fd64', '4cea141c-e821-4109-acf9-ef94f8cb95d7', '91383f81-6917-49c8-9498-b06a3be72ffb'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:02:59 devstack sudo[102102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:02:59 devstack sudo[102102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:02:59 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root
Jul 06 21:02:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84 1073741824" returned: 0 in 0.837s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:00 devstack sudo[102107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84
Jul 06 21:03:00 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "cinder-87179588-c45d-40d4-b9a2-d829cf3fec2c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-87179588-c45d-40d4-b9a2-d829cf3fec2c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "cinder-quobyte-87179588-c45d-40d4-b9a2-d829cf3fec2c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-quobyte-87179588-c45d-40d4-b9a2-d829cf3fec2c" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:00 devstack sudo[102102]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.721s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:03:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Deleted volume successfully.
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[72fe46f9-ccc8-4818-a526-52626b9b1cc6]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-78517c7d-ce58-4703-a29f-e0579cb0625a tempest-VolumesListTestJSON-277798741 None] Lock "cinder-65d8e826-d231-4826-9bf3-4d8d02d31580-delete_volume" released by "delete_volume" :: held 2.500s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:00 devstack sudo[102110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c
Jul 06 21:03:00 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:00 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84" returned: 0 in 0.688s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372f0084-e681-4716-9b86-b66db0ed836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cef5a409-a672-4f0d-92e4-a97480382f84', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b5d558-fbd2-4b9c-86a7-3d69beb8de67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Volume volume-cef5a409-a672-4f0d-92e4-a97480382f84 (cef5a409-a672-4f0d-92e4-a97480382f84): created successfully
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3b5d558-fbd2-4b9c-86a7-3d69beb8de67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Flow 'volume_create_manager' (7875c924-c391-484a-aed3-4506886f006e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:03:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-052f072c-d3fe-4e53-9fb6-fde0309bc8d1 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Created volume successfully.
Jul 06 21:03:01 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c" returned: 0 in 0.778s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:01 devstack sudo[102116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c
Jul 06 21:03:01 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:01 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-87179588-c45d-40d4-b9a2-d829cf3fec2c" returned: 0 in 0.650s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-quobyte-87179588-c45d-40d4-b9a2-d829cf3fec2c" released by "delete_volume" :: held 1.478s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Created reservations ['d2d15dc2-83e1-4981-9b00-a1988f7981f8', '6dfcb563-e68c-4bdc-af1a-2b1bdc041a25', '224a6067-e2d7-4fe8-9a2d-c56d28c24aa2', '96d5514b-64b2-40ea-91e0-db669cf95cb9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:01 devstack sudo[102122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:03:01 devstack sudo[102122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "cinder-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:02 devstack sudo[102122]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.681s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:03:02 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Deleted volume successfully.
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "cinder-quobyte-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-82403baf-7ac6-42c7-891d-7c6c44e8e013 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-87179588-c45d-40d4-b9a2-d829cf3fec2c-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-quobyte-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b19e223-da7d-46dd-aa80-b4cb259d0be1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:03:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:02 devstack sudo[102125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301
Jul 06 21:03:02 devstack sudo[102125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:03 devstack sudo[102125]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301" returned: 0 in 0.755s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:03 devstack sudo[102130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301
Jul 06 21:03:03 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:03 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301" returned: 0 in 0.666s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-quobyte-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301" released by "delete_volume" :: held 1.460s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Created reservations ['2ea4bdf7-b43a-41c3-aaea-064d63901d04', '20071a89-94af-468c-b7ba-26b886702d75', 'f18457e9-0b6c-4f59-a95e-b220376b5af0', '0d9b7768-a11f-417f-bafa-4c6f981c1a34'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:04 devstack sudo[102141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:03:04 devstack sudo[102141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-f26d26fc-843f-4ee6-bc57-aa2387cb8800 req-6853ac8d-761d-4778-8527-51f36d638fc2 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-f26d26fc-843f-4ee6-bc57-aa2387cb8800 req-6853ac8d-761d-4778-8527-51f36d638fc2 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd8d190-2e22-481a-8001-61902476ae56]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-f26d26fc-843f-4ee6-bc57-aa2387cb8800 req-6853ac8d-761d-4778-8527-51f36d638fc2 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:04 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84
Jul 06 21:03:04 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:04 devstack sudo[102141]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.729s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:03:04 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Deleted volume successfully.
Jul 06 21:03:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-da295986-bfba-476c-b835-523f6a87aff0 tempest-VolumesListTestJSON-277798741 None] Lock "cinder-a0f7fa17-0df2-4a8a-aaa1-ba7100ef2301-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:05 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-f26d26fc-843f-4ee6-bc57-aa2387cb8800 req-6853ac8d-761d-4778-8527-51f36d638fc2 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84" returned: 0 in 0.842s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-f26d26fc-843f-4ee6-bc57-aa2387cb8800 req-6853ac8d-761d-4778-8527-51f36d638fc2 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-f26d26fc-843f-4ee6-bc57-aa2387cb8800 req-6853ac8d-761d-4778-8527-51f36d638fc2 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-cef5a409-a672-4f0d-92e4-a97480382f84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3a5620d-8f10-49ad-9d03-5da7b7b9038f', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:03:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-f26d26fc-843f-4ee6-bc57-aa2387cb8800 req-6853ac8d-761d-4778-8527-51f36d638fc2 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] attachment_update completed successfully.
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Flow 'volume_create_manager' (0436e1a1-e96f-48f6-a01f-ffac9709331b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3703ad-af3f-4509-a98e-58038d9a2be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c3703ad-af3f-4509-a98e-58038d9a2be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1054537778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb1dff-99e5-4338-b167-ec721934dff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4143614e702341268c521f9c47d73a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:07Z,use_quota=True,user_id='a489186f205f4fedae0b1785f209c01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c347e2f-8759-49ae-8950-001975f43665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c347e2f-8759-49ae-8950-001975f43665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdd493c-78ec-42ed-95b5-87eff1f1affa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cdd493c-78ec-42ed-95b5-87eff1f1affa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58cb1dff-99e5-4338-b167-ec721934dff0', 'volume_name': 'volume-58cb1dff-99e5-4338-b167-ec721934dff0', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfcd500-74d2-4406-bd51-defeac82d44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcfcd500-74d2-4406-bd51-defeac82d44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c5b3e-7705-4b84-97f2-40eddd15e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:07 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Volume 58cb1dff-99e5-4338-b167-ec721934dff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58cb1dff-99e5-4338-b167-ec721934dff0', 'volume_size': 1}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1054537778',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58cb1dff-99e5-4338-b167-ec721934dff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4143614e702341268c521f9c47d73a78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:07Z,use_quota=True,user_id='a489186f205f4fedae0b1785f209c01f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Creating volume 58cb1dff-99e5-4338-b167-ec721934dff0 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:03:07 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:03:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:07 devstack sudo[102532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0 1073741824
Jul 06 21:03:07 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:08 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0 1073741824" returned: 0 in 0.830s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:08 devstack sudo[102539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0
Jul 06 21:03:08 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:09 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0" returned: 0 in 0.637s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:03:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0c5b3e-7705-4b84-97f2-40eddd15e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58cb1dff-99e5-4338-b167-ec721934dff0', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b324965c-9316-4baf-9332-f36807513447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:09 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Volume volume-58cb1dff-99e5-4338-b167-ec721934dff0 (58cb1dff-99e5-4338-b167-ec721934dff0): created successfully
Jul 06 21:03:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b324965c-9316-4baf-9332-f36807513447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Flow 'volume_create_manager' (0436e1a1-e96f-48f6-a01f-ffac9709331b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:03:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-54afd641-bec9-44ce-8a6b-199e7d794e19 tempest-VolumesNegativeTest-2046296873 None] Created volume successfully.
Jul 06 21:03:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-ff8d14c8-7eb1-4c23-845a-eaccc02f7ae6 req-9bd446d5-3732-495d-92f3-14dcbace19d9 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Terminate volume connection completed successfully.
Jul 06 21:03:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-ff8d14c8-7eb1-4c23-845a-eaccc02f7ae6 req-9bd446d5-3732-495d-92f3-14dcbace19d9 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Deleting attachment b3a5620d-8f10-49ad-9d03-5da7b7b9038f. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:03:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Acquiring lock "cinder-cef5a409-a672-4f0d-92e4-a97480382f84-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "cinder-cef5a409-a672-4f0d-92e4-a97480382f84-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Acquiring lock "cinder-quobyte-cef5a409-a672-4f0d-92e4-a97480382f84" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "cinder-quobyte-cef5a409-a672-4f0d-92e4-a97480382f84" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df99dfb-ec69-43b2-8416-3a76329a2fe2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:03:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:14 devstack sudo[102608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84
Jul 06 21:03:14 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:14 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84" returned: 0 in 0.781s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:14 devstack sudo[102614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84
Jul 06 21:03:14 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:15 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-cef5a409-a672-4f0d-92e4-a97480382f84" returned: 0 in 0.764s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "cinder-quobyte-cef5a409-a672-4f0d-92e4-a97480382f84" released by "delete_volume" :: held 1.597s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Created reservations ['11fbcca5-0b40-44a6-a0e0-df09a2402b0b', 'ba7f184b-b630-41f9-8818-c3e5745287ee', 'c6a6a8d4-680c-472d-8f8c-453a7c259b31', 'aec408b0-8211-47fa-a770-8d08468dd7a0'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:15 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:03:15 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:16 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.844s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:16 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:03:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Deleted volume successfully.
Jul 06 21:03:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c3625f8a-890a-4f21-bdf9-accef0bb0399 tempest-TestServerVolumeAttachScenarioOldVersion-726387495 None] Lock "cinder-cef5a409-a672-4f0d-92e4-a97480382f84-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:25 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=45,cinder:UPDATE=54,cinder:DELETE=5,cinder:INSERT=12 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:03:26 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=42,cinder:UPDATE=65,cinder:INSERT=14,cinder:DELETE=6 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:03:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:03:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:03:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:03:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:37 devstack sudo[102772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:03:37 devstack sudo[102772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:38 devstack sudo[102772]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.744s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Acquiring lock "cinder-58cb1dff-99e5-4338-b167-ec721934dff0-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Lock "cinder-58cb1dff-99e5-4338-b167-ec721934dff0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Acquiring lock "cinder-quobyte-58cb1dff-99e5-4338-b167-ec721934dff0" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Lock "cinder-quobyte-58cb1dff-99e5-4338-b167-ec721934dff0" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[68967390-96ef-4b42-b2f5-76d9d61b8e59]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:03:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:39 devstack sudo[102777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0
Jul 06 21:03:39 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:39 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:39 devstack sudo[102782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0
Jul 06 21:03:39 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:40 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-58cb1dff-99e5-4338-b167-ec721934dff0" returned: 0 in 0.680s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Lock "cinder-quobyte-58cb1dff-99e5-4338-b167-ec721934dff0" released by "delete_volume" :: held 1.500s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Created reservations ['a06498af-0ab6-48da-8ff0-452766e00406', '38533de8-aad2-430b-9a94-aef3c6a5ab5e', 'c78bc14a-ecfd-4d5b-89b8-c81ee2aa313e', '04b41555-8646-407f-8496-0d35153e22a9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:40 devstack sudo[102785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:03:40 devstack sudo[102785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:41 devstack sudo[102785]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.742s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:41 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:03:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Deleted volume successfully.
Jul 06 21:03:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-49b9eece-da0e-4897-b0ea-167610f19c57 tempest-VolumesNegativeTest-2046296873 None] Lock "cinder-58cb1dff-99e5-4338-b167-ec721934dff0-delete_volume" released by "delete_volume" :: held 2.489s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:03:50 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=2 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:03:51 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Flow 'volume_create_manager' (d79eb0e6-89e2-40da-9e11-34eaaf00a058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b66cab8-25b0-4a80-8841-99e2ffeba21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b66cab8-25b0-4a80-8841-99e2ffeba21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-362730894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482cb1a0-5a4a-46b8-8ac8-6603693e9de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bad8633f404dd79eb85eb7e62a91f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:58Z,use_quota=True,user_id='abf17a3805bc4e0e983f1c7ce888eebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dd136c-618c-4d84-b6e9-0101fd49a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97dd136c-618c-4d84-b6e9-0101fd49a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbf3472-e26e-4faa-ae45-0e841f0ed3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cbf3472-e26e-4faa-ae45-0e841f0ed3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482cb1a0-5a4a-46b8-8ac8-6603693e9de9', 'volume_name': 'volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e1730a-7612-427d-95d7-bedb1c519e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e1730a-7612-427d-95d7-bedb1c519e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143ea1d3-f45f-4828-a09f-59c35e3ecac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Volume 482cb1a0-5a4a-46b8-8ac8-6603693e9de9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9', 'volume_size': 1}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-362730894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=482cb1a0-5a4a-46b8-8ac8-6603693e9de9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bad8633f404dd79eb85eb7e62a91f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:58Z,use_quota=True,user_id='abf17a3805bc4e0e983f1c7ce888eebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Creating volume 482cb1a0-5a4a-46b8-8ac8-6603693e9de9 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:03:58 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:58 devstack sudo[102794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 1073741824
Jul 06 21:03:58 devstack sudo[102794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Flow 'volume_create_manager' (f59f973a-7a9c-49ea-91d6-74c8241c586a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d164e04c-e6c9-4a7d-b3ef-d4d9dc446909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d164e04c-e6c9-4a7d-b3ef-d4d9dc446909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-439859260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b493d3-1dd4-44ea-8be4-123271e21864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bad8633f404dd79eb85eb7e62a91f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:59Z,use_quota=True,user_id='abf17a3805bc4e0e983f1c7ce888eebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea0e95b-258b-43b9-9c3e-50cd09023d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ea0e95b-258b-43b9-9c3e-50cd09023d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b2661-9aeb-47b6-8258-23cb91ecb337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (725b2661-9aeb-47b6-8258-23cb91ecb337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b493d3-1dd4-44ea-8be4-123271e21864', 'volume_name': 'volume-80b493d3-1dd4-44ea-8be4-123271e21864', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9935251e-1e87-47ab-a49f-694503b596fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9935251e-1e87-47ab-a49f-694503b596fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47157a7-36c1-4f1c-954f-5142f06a1eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:03:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Volume 80b493d3-1dd4-44ea-8be4-123271e21864: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b493d3-1dd4-44ea-8be4-123271e21864', 'volume_size': 1}
Jul 06 21:03:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:03:59 devstack sudo[102794]: pam_unix(sudo:session): session closed for user root
Jul 06 21:03:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 1073741824" returned: 0 in 1.169s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:03:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:03:59 devstack sudo[102800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9
Jul 06 21:03:59 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:00 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9" returned: 0 in 0.729s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-439859260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b493d3-1dd4-44ea-8be4-123271e21864,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7bad8633f404dd79eb85eb7e62a91f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:03:59Z,use_quota=True,user_id='abf17a3805bc4e0e983f1c7ce888eebc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Creating volume 80b493d3-1dd4-44ea-8be4-123271e21864 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:04:00 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:00 devstack sudo[102803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864 1073741824
Jul 06 21:04:00 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143ea1d3-f45f-4828-a09f-59c35e3ecac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b63557-07a6-41bd-825f-fd020b269fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Volume volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 (482cb1a0-5a4a-46b8-8ac8-6603693e9de9): created successfully
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02b63557-07a6-41bd-825f-fd020b269fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Flow 'volume_create_manager' (d79eb0e6-89e2-40da-9e11-34eaaf00a058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:04:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e0edaa50-9186-4123-98b4-00be8f000ac0 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Created volume successfully.
Jul 06 21:04:01 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864 1073741824" returned: 0 in 0.909s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:01 devstack sudo[102809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864
Jul 06 21:04:01 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:02 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864" returned: 0 in 0.881s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:04:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.853s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47157a7-36c1-4f1c-954f-5142f06a1eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b493d3-1dd4-44ea-8be4-123271e21864', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6053a47c-b796-4be1-8893-c27faae37063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:02 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Volume volume-80b493d3-1dd4-44ea-8be4-123271e21864 (80b493d3-1dd4-44ea-8be4-123271e21864): created successfully
Jul 06 21:04:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6053a47c-b796-4be1-8893-c27faae37063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Flow 'volume_create_manager' (f59f973a-7a9c-49ea-91d6-74c8241c586a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:04:02 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a492241b-f5f2-48b4-b324-cb926a798aff tempest-TestServerVolumeAttachmentScenario-1482029460 None] Created volume successfully.
Jul 06 21:04:12 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:04:12 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=2 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Flow 'volume_create_manager' (0198074d-66fe-44ad-96c3-36e30c3802d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741b46fe-0e9c-46c4-8fea-25739ba06b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (741b46fe-0e9c-46c4-8fea-25739ba06b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1254908867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a92100-3307-4bed-86d2-815bdaebd7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98608fcda99540e0a2dbdf8a2e4b556a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:04:25Z,use_quota=True,user_id='b0c08fefcc494d2a81b60e4291d862f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1387bf-bccf-4867-b07a-60507ec1a04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b1387bf-bccf-4867-b07a-60507ec1a04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68654fc3-6189-401a-9db2-1822f9b6b35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68654fc3-6189-401a-9db2-1822f9b6b35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a92100-3307-4bed-86d2-815bdaebd7a2', 'volume_name': 'volume-76a92100-3307-4bed-86d2-815bdaebd7a2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5e3120-6573-4438-8ef1-1a4ab1e12105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5e3120-6573-4438-8ef1-1a4ab1e12105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e977c1a-6eab-4887-85f8-5c0f4c47cc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Volume 76a92100-3307-4bed-86d2-815bdaebd7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a92100-3307-4bed-86d2-815bdaebd7a2', 'volume_size': 1}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1254908867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a92100-3307-4bed-86d2-815bdaebd7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98608fcda99540e0a2dbdf8a2e4b556a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:04:25Z,use_quota=True,user_id='b0c08fefcc494d2a81b60e4291d862f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Creating volume 76a92100-3307-4bed-86d2-815bdaebd7a2 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:04:25 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:04:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:25 devstack sudo[103064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2 1073741824
Jul 06 21:04:25 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:26 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2 1073741824" returned: 0 in 0.923s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:26 devstack sudo[103070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2
Jul 06 21:04:26 devstack sudo[103070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:27 devstack sudo[103070]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2" returned: 0 in 0.704s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:04:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e977c1a-6eab-4887-85f8-5c0f4c47cc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a92100-3307-4bed-86d2-815bdaebd7a2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedf9aa2-8269-4275-b910-45e8b697752a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:04:27 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Volume volume-76a92100-3307-4bed-86d2-815bdaebd7a2 (76a92100-3307-4bed-86d2-815bdaebd7a2): created successfully
Jul 06 21:04:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedf9aa2-8269-4275-b910-45e8b697752a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:04:27 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Flow 'volume_create_manager' (0198074d-66fe-44ad-96c3-36e30c3802d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:04:27 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bbfbde5e-0d4a-4474-8ef3-38eebca85080 tempest-TestMinimumBasicScenario-1805256625 None] Created volume successfully.
Jul 06 21:04:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-6f16d4fa-873c-4285-861d-6a3302e60367 req-03e14b23-3bdb-479d-97e9-5e4235b8fcba tempest-TestMinimumBasicScenario-1805256625 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:04:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-6f16d4fa-873c-4285-861d-6a3302e60367 req-03e14b23-3bdb-479d-97e9-5e4235b8fcba tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:30 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb986e-02a8-410a-af3c-b24740a7850b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:04:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-6f16d4fa-873c-4285-861d-6a3302e60367 req-03e14b23-3bdb-479d-97e9-5e4235b8fcba tempest-TestMinimumBasicScenario-1805256625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:30 devstack sudo[103102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2
Jul 06 21:04:30 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:31 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-6f16d4fa-873c-4285-861d-6a3302e60367 req-03e14b23-3bdb-479d-97e9-5e4235b8fcba tempest-TestMinimumBasicScenario-1805256625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2" returned: 0 in 0.815s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-6f16d4fa-873c-4285-861d-6a3302e60367 req-03e14b23-3bdb-479d-97e9-5e4235b8fcba tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-6f16d4fa-873c-4285-861d-6a3302e60367 req-03e14b23-3bdb-479d-97e9-5e4235b8fcba tempest-TestMinimumBasicScenario-1805256625 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-76a92100-3307-4bed-86d2-815bdaebd7a2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b7658fc-7683-40ef-8876-9b7e63b2f342', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:04:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-6f16d4fa-873c-4285-861d-6a3302e60367 req-03e14b23-3bdb-479d-97e9-5e4235b8fcba tempest-TestMinimumBasicScenario-1805256625 None] attachment_update completed successfully.
Jul 06 21:04:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:04:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:04:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:04:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:04:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:37 devstack sudo[103516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:04:37 devstack sudo[103516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:38 devstack sudo[103516]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.722s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:04:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:04:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:04:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:04:41 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:04:41 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=3,cinder:SELECT=9,cinder:INSERT=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:04:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-b191fb8d-4487-42a8-b718-557fd4379099 req-a6609d6c-780b-48b9-85a6-5ab88e601b7c tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:04:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-b191fb8d-4487-42a8-b718-557fd4379099 req-a6609d6c-780b-48b9-85a6-5ab88e601b7c tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[955c58cf-c1df-40a1-b6e1-c4ea73fb3b54]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:04:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-b191fb8d-4487-42a8-b718-557fd4379099 req-a6609d6c-780b-48b9-85a6-5ab88e601b7c tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:43 devstack sudo[103539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9
Jul 06 21:04:43 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:44 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-b191fb8d-4487-42a8-b718-557fd4379099 req-a6609d6c-780b-48b9-85a6-5ab88e601b7c tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9" returned: 0 in 0.785s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-b191fb8d-4487-42a8-b718-557fd4379099 req-a6609d6c-780b-48b9-85a6-5ab88e601b7c tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.814s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-b191fb8d-4487-42a8-b718-557fd4379099 req-a6609d6c-780b-48b9-85a6-5ab88e601b7c tempest-TestServerVolumeAttachmentScenario-1482029460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9665783-0544-4efb-9a10-0b3eb1c7672e', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:04:44 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-b191fb8d-4487-42a8-b718-557fd4379099 req-a6609d6c-780b-48b9-85a6-5ab88e601b7c tempest-TestServerVolumeAttachmentScenario-1482029460 None] attachment_update completed successfully.
Jul 06 21:04:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-2bf8792e-8acb-4b3c-b703-21a8e7d353d5 req-e474779a-6af6-41f4-a696-aa919a022844 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:04:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-2bf8792e-8acb-4b3c-b703-21a8e7d353d5 req-e474779a-6af6-41f4-a696-aa919a022844 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:04:53 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b46c6a-27b7-478c-895d-096d1a246d2a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:04:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-2bf8792e-8acb-4b3c-b703-21a8e7d353d5 req-e474779a-6af6-41f4-a696-aa919a022844 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:04:53 devstack sudo[103591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864
Jul 06 21:04:53 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:04:54 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root
Jul 06 21:04:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-2bf8792e-8acb-4b3c-b703-21a8e7d353d5 req-e474779a-6af6-41f4-a696-aa919a022844 tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864" returned: 0 in 0.829s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:04:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-2bf8792e-8acb-4b3c-b703-21a8e7d353d5 req-e474779a-6af6-41f4-a696-aa919a022844 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.846s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:04:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-2bf8792e-8acb-4b3c-b703-21a8e7d353d5 req-e474779a-6af6-41f4-a696-aa919a022844 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-80b493d3-1dd4-44ea-8be4-123271e21864', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'debaf140-87f7-49ec-a8ea-58f69afe5146', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:04:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-2bf8792e-8acb-4b3c-b703-21a8e7d353d5 req-e474779a-6af6-41f4-a696-aa919a022844 tempest-TestServerVolumeAttachmentScenario-1482029460 None] attachment_update completed successfully.
Jul 06 21:04:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-4c61debc-21cf-4ba3-b796-341fd643cec9 req-aa2c9d3c-a2b9-4fce-bd62-2333780cb4b2 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Terminate volume connection completed successfully.
Jul 06 21:04:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-4c61debc-21cf-4ba3-b796-341fd643cec9 req-aa2c9d3c-a2b9-4fce-bd62-2333780cb4b2 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Deleting attachment debaf140-87f7-49ec-a8ea-58f69afe5146. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:05:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-775c82a3-5fab-4670-9993-f674a604c984 req-32343370-67db-4d7c-b83c-8b5e8ec3c8a2 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Terminate volume connection completed successfully.
Jul 06 21:05:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-775c82a3-5fab-4670-9993-f674a604c984 req-32343370-67db-4d7c-b83c-8b5e8ec3c8a2 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Deleting attachment f9665783-0544-4efb-9a10-0b3eb1c7672e. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:05:13 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=15,cinder:UPDATE=4 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:05:13 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=12,cinder:UPDATE=3 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:05:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "cinder-80b493d3-1dd4-44ea-8be4-123271e21864-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-80b493d3-1dd4-44ea-8be4-123271e21864-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "cinder-quobyte-80b493d3-1dd4-44ea-8be4-123271e21864" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-quobyte-80b493d3-1dd4-44ea-8be4-123271e21864" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a6f690-956c-4af0-b7ca-4863bec0b62b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:05:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:14 devstack sudo[103697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864
Jul 06 21:05:14 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:14 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864" returned: 0 in 0.838s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:14 devstack sudo[103706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864
Jul 06 21:05:14 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:15 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-80b493d3-1dd4-44ea-8be4-123271e21864" returned: 0 in 0.690s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-quobyte-80b493d3-1dd4-44ea-8be4-123271e21864" released by "delete_volume" :: held 1.579s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Created reservations ['b7219db0-e5fd-489a-a0d7-1c717956ae0f', 'f9d13df3-3420-4db1-852a-d93da87167da', 'a113d34f-bb60-4304-b0bc-4fef45188f0f', 'c2011066-dd19-4812-9742-dd3caa8e953a'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:15 devstack sudo[103709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:05:15 devstack sudo[103709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "cinder-482cb1a0-5a4a-46b8-8ac8-6603693e9de9-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-482cb1a0-5a4a-46b8-8ac8-6603693e9de9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "cinder-quobyte-482cb1a0-5a4a-46b8-8ac8-6603693e9de9" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-quobyte-482cb1a0-5a4a-46b8-8ac8-6603693e9de9" acquired by "delete_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13614bc-67a3-41ac-9844-98ed9aeeae68]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:16 devstack sudo[103709]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.773s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:05:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Deleted volume successfully.
Jul 06 21:05:16 devstack sudo[103713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9
Jul 06 21:05:16 devstack sudo[103713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-22ad2cd1-d8e0-4f08-8b55-ab5d4d4949be tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-80b493d3-1dd4-44ea-8be4-123271e21864-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:17 devstack sudo[103713]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9" returned: 0 in 0.940s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:17 devstack sudo[103721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9
Jul 06 21:05:17 devstack sudo[103721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:17 devstack sudo[103721]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-482cb1a0-5a4a-46b8-8ac8-6603693e9de9" returned: 0 in 0.703s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-quobyte-482cb1a0-5a4a-46b8-8ac8-6603693e9de9" released by "delete_volume" :: held 1.692s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Created reservations ['e964d19b-371c-487a-9ab3-e82e2032bc64', '197055b2-665f-412c-bb8e-110eb59d9e8a', 'c87a1c60-0e42-4377-9d7c-7d9eb214e55a', 'fcabd9ce-eb1e-4eba-aa84-52325bb88e62'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:18 devstack sudo[103732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:05:18 devstack sudo[103732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-010e0107-473c-4fde-90a0-b9132336e3d4 req-d634851f-44ef-4e01-a479-a4c7e5801a5f tempest-TestMinimumBasicScenario-1805256625 None] Terminate volume connection completed successfully.
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-010e0107-473c-4fde-90a0-b9132336e3d4 req-d634851f-44ef-4e01-a479-a4c7e5801a5f tempest-TestMinimumBasicScenario-1805256625 None] Deleting attachment 9b7658fc-7683-40ef-8876-9b7e63b2f342. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:05:18 devstack sudo[103732]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.782s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:05:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Deleted volume successfully.
Jul 06 21:05:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b998ebbb-f236-418f-914d-82eaa94f0a69 tempest-TestServerVolumeAttachmentScenario-1482029460 None] Lock "cinder-482cb1a0-5a4a-46b8-8ac8-6603693e9de9-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Acquiring lock "cinder-76a92100-3307-4bed-86d2-815bdaebd7a2-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Lock "cinder-76a92100-3307-4bed-86d2-815bdaebd7a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Acquiring lock "cinder-quobyte-76a92100-3307-4bed-86d2-815bdaebd7a2" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Lock "cinder-quobyte-76a92100-3307-4bed-86d2-815bdaebd7a2" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:21 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[557638c5-2f68-41fa-b72d-fe5d0884e627]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:05:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:21 devstack sudo[103740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2
Jul 06 21:05:21 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:21 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2" returned: 0 in 0.884s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:21 devstack sudo[103751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2
Jul 06 21:05:21 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:22 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-76a92100-3307-4bed-86d2-815bdaebd7a2" returned: 0 in 0.687s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Lock "cinder-quobyte-76a92100-3307-4bed-86d2-815bdaebd7a2" released by "delete_volume" :: held 1.615s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Created reservations ['a7fe922a-8b4b-4ae7-81f8-db0563bc467d', 'a40ceae1-78ca-45a8-aa95-c674c8fb24b1', '10416122-04a1-483c-b0a3-ec2d0cae8920', '857d7e82-2791-4091-8d7f-2ae236ade870'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:22 devstack sudo[103755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:05:22 devstack sudo[103755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:23 devstack sudo[103755]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.758s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:05:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Deleted volume successfully.
Jul 06 21:05:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-70a23bb3-60e0-436d-92a5-da16b7959491 tempest-TestMinimumBasicScenario-1805256625 None] Lock "cinder-76a92100-3307-4bed-86d2-815bdaebd7a2-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:32 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=24,cinder:SELECT=13,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:05:33 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=19,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:05:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:05:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:37 devstack sudo[103788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:05:37 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:38 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:05:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:05:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:05:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Flow 'volume_create_manager' (88cc52cc-a850-4360-96fc-5d6ce0b0afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8dbb17-51b9-4598-afda-2ce848e87a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be8dbb17-51b9-4598-afda-2ce848e87a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124225638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e21a6d-63f5-4091-82b5-21a1a1c2fca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac4c20aaeed465783fe18366a2e0c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:42Z,use_quota=True,user_id='e106411b115a458292d5bcb7e8b2f776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9ddc16-cb41-4335-b762-00d540ef7028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9ddc16-cb41-4335-b762-00d540ef7028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1318fde-cd94-4f54-b1a9-595dffb05179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1318fde-cd94-4f54-b1a9-595dffb05179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e21a6d-63f5-4091-82b5-21a1a1c2fca7', 'volume_name': 'volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fcc21d-e80a-47c4-b769-2dffd5c0a7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fcc21d-e80a-47c4-b769-2dffd5c0a7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f52257a-81c4-4c19-8666-cb49dc4d0bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:42 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Volume a8e21a6d-63f5-4091-82b5-21a1a1c2fca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7', 'volume_size': 1}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1124225638',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e21a6d-63f5-4091-82b5-21a1a1c2fca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac4c20aaeed465783fe18366a2e0c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:42Z,use_quota=True,user_id='e106411b115a458292d5bcb7e8b2f776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Creating volume a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:05:42 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:05:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:42 devstack sudo[103796]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 1073741824
Jul 06 21:05:42 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:43 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 1073741824" returned: 0 in 0.911s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:43 devstack sudo[103802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7
Jul 06 21:05:43 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:43 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" returned: 0 in 0.675s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f52257a-81c4-4c19-8666-cb49dc4d0bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0179623-bcb9-4ff3-9986-2f795c195622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Volume volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 (a8e21a6d-63f5-4091-82b5-21a1a1c2fca7): created successfully
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0179623-bcb9-4ff3-9986-2f795c195622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Flow 'volume_create_manager' (88cc52cc-a850-4360-96fc-5d6ce0b0afc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:05:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6526d7f4-6fbb-4c47-a982-cabd7d76f243 tempest-VolumeDependencyTests-1251599722 None] Created volume successfully.
Jul 06 21:05:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Creating offline snapshot d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c of volume a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:05:44 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0256b08b-c090-45cd-8349-f81c880d6d1a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:05:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:44 devstack sudo[103805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7
Jul 06 21:05:44 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:45 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" returned: 0 in 0.965s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:45 devstack sudo[103810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c 1G
Jul 06 21:05:45 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:46 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c 1G" returned: 0 in 0.897s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:46 devstack sudo[103815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c
Jul 06 21:05:46 devstack sudo[103815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:47 devstack sudo[103815]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" returned: 0 in 0.733s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:47 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c is being set with open permissions: ugo+rw
Jul 06 21:05:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:47 devstack sudo[103820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c
Jul 06 21:05:47 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:47 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" returned: 0 in 0.652s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:47 devstack sudo[103823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.info
Jul 06 21:05:47 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:48 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.info" returned: 0 in 0.728s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:48 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.info is being set with open permissions: ugo+rw
Jul 06 21:05:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:48 devstack sudo[103827]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.info
Jul 06 21:05:48 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:49 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.info" returned: 0 in 0.687s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.785s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3eb241aa-51ba-4235-8f27-a7cfe2bc3498 tempest-VolumeDependencyTests-1251599722 None] Create snapshot completed successfully
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Flow 'volume_create_manager' (117eb2d8-3cfe-4cd2-a32e-a4eeeaab5eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be9f0ce-d8c1-4c28-af0c-56734091e26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be9f0ce-d8c1-4c28-af0c-56734091e26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-886680455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00037bc5-e5a7-4018-ba80-d3f0692ec423,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fac4c20aaeed465783fe18366a2e0c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:50Z,use_quota=True,user_id='e106411b115a458292d5bcb7e8b2f776',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58d74ed-fcde-49d2-87d6-330d55f24574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58d74ed-fcde-49d2-87d6-330d55f24574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee3dcd9-e6e5-451b-a22a-ff7517c74f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ee3dcd9-e6e5-451b-a22a-ff7517c74f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '00037bc5-e5a7-4018-ba80-d3f0692ec423', 'volume_name': 'volume-00037bc5-e5a7-4018-ba80-d3f0692ec423', 'volume_size': 1, 'snapshot_id': 'd9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e309cde5-973d-4d1b-b355-9cfc204bb70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e309cde5-973d-4d1b-b355-9cfc204bb70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f096e72-a4f4-4dd4-a418-1c7ab646f771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Volume 00037bc5-e5a7-4018-ba80-d3f0692ec423: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-00037bc5-e5a7-4018-ba80-d3f0692ec423', 'volume_size': 1, 'snapshot_id': 'd9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c'}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-quobyte-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c-00037bc5-e5a7-4018-ba80-d3f0692ec423" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c-00037bc5-e5a7-4018-ba80-d3f0692ec423" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Creating volume 00037bc5-e5a7-4018-ba80-d3f0692ec423 from snapshot d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-quobyte-00037bc5-e5a7-4018-ba80-d3f0692ec423" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-00037bc5-e5a7-4018-ba80-d3f0692ec423" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] snapshot: d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c, volume: 00037bc5-e5a7-4018-ba80-d3f0692ec423,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[566aac06-5d8c-4bef-803d-3346a4ee9658]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:05:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:50 devstack sudo[103830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c
Jul 06 21:05:50 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:51 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" returned: 0 in 0.835s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:05:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 21:05:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 21:05:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[449b0a9d-449c-469b-b7bf-f1a43f0a35f1]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:05:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:51 devstack sudo[103836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7
Jul 06 21:05:51 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:52 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" returned: 0 in 0.863s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:52 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 21:05:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:52 devstack sudo[103841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423
Jul 06 21:05:52 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Flow 'volume_create_manager' (fba1c04d-a36e-44c1-8e62-ad30a9541eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80ea73e-a05b-4bf4-915c-e72e864e1ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80ea73e-a05b-4bf4-915c-e72e864e1ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-438453974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d83376-0b46-4523-9c5a-3e6404ac556e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae021dd4a5e49908e51ef59c93daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:56Z,use_quota=True,user_id='dafa166452ee46b2a5f762097b977a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc651f5c-7a67-4170-b643-5ebb6512ca42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc651f5c-7a67-4170-b643-5ebb6512ca42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdb9c5e-a34e-46ae-bb9a-53fcd99056ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cdb9c5e-a34e-46ae-bb9a-53fcd99056ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d83376-0b46-4523-9c5a-3e6404ac556e', 'volume_name': 'volume-17d83376-0b46-4523-9c5a-3e6404ac556e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91952cac-e610-4e49-83fb-c103404ba70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91952cac-e610-4e49-83fb-c103404ba70b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c50545-8130-400b-bf65-f66668ca0667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:56 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Volume 17d83376-0b46-4523-9c5a-3e6404ac556e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d83376-0b46-4523-9c5a-3e6404ac556e', 'volume_size': 1}
Jul 06 21:05:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:57 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423" returned: 0 in 5.271s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b859983-8180-48cf-b9fa-7c45796f8e76]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:05:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:57 devstack sudo[103855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7
Jul 06 21:05:57 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:58 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" returned: 0 in 0.995s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:58 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7, size 1024.00 MB, duration 5.27 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:05:58 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Converted 1024.00 MB image at 194.24 MB/s
Jul 06 21:05:58 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 is being set with open permissions: ugo+rw
Jul 06 21:05:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:58 devstack sudo[103864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423
Jul 06 21:05:58 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:59 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423" returned: 0 in 0.642s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-00037bc5-e5a7-4018-ba80-d3f0692ec423" released by "_copy_volume_from_snapshot" :: held 8.745s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c-00037bc5-e5a7-4018-ba80-d3f0692ec423" released by "_create_volume_from_snapshot" :: held 8.780s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.800s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.862s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-438453974',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d83376-0b46-4523-9c5a-3e6404ac556e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae021dd4a5e49908e51ef59c93daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:56Z,use_quota=True,user_id='dafa166452ee46b2a5f762097b977a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Creating volume 17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:05:59 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:05:59 devstack sudo[103867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e 1073741824
Jul 06 21:05:59 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f096e72-a4f4-4dd4-a418-1c7ab646f771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00037bc5-e5a7-4018-ba80-d3f0692ec423', 'volume_size': 1, 'snapshot_id': 'd9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bd0d2f-f5ba-4414-84ae-a82da8c427f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:05:59 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Volume volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 (00037bc5-e5a7-4018-ba80-d3f0692ec423): created successfully
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58bd0d2f-f5ba-4414-84ae-a82da8c427f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:05:59 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Flow 'volume_create_manager' (117eb2d8-3cfe-4cd2-a32e-a4eeeaab5eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:05:59 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-23d84c7c-5802-45a9-bd36-dfa2b14c88e5 tempest-VolumeDependencyTests-1251599722 None] Created volume successfully.
Jul 06 21:06:00 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e 1073741824" returned: 0 in 0.879s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:00 devstack sudo[103873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:06:00 devstack sudo[103873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-quobyte-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-quobyte-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Deleting offline snapshot d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c of volume a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] snapshot_file for this snap is: volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e474361a-fd8e-466b-a8d5-0e8f358048fe]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:00 devstack sudo[103875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c
Jul 06 21:06:00 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:00 devstack sudo[103873]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 0.674s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c50545-8130-400b-bf65-f66668ca0667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d83376-0b46-4523-9c5a-3e6404ac556e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19998b7a-bb8a-402d-a370-30eead7fc8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:06:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Volume volume-17d83376-0b46-4523-9c5a-3e6404ac556e (17d83376-0b46-4523-9c5a-3e6404ac556e): created successfully
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19998b7a-bb8a-402d-a370-30eead7fc8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:06:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Flow 'volume_create_manager' (fba1c04d-a36e-44c1-8e62-ad30a9541eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:06:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-20199440-b822-43e0-bc0e-c3017ce9271a tempest-TestStampPattern-1857016485 None] Created volume successfully.
Jul 06 21:06:01 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:06:01 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e365316-8ad5-4ef0-af65-d0cd72e20a32]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:06:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:01 devstack sudo[103882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7
Jul 06 21:06:01 devstack sudo[103882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:02 devstack sudo[103882]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" returned: 0 in 0.766s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:02 devstack sudo[103887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c
Jul 06 21:06:02 devstack sudo[103887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:02 devstack sudo[103887]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" returned: 0 in 0.754s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:02 devstack sudo[103892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c
Jul 06 21:06:02 devstack sudo[103892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:03 devstack sudo[103892]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7.d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" returned: 0 in 0.858s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c" released by "_delete_snapshot" :: held 3.295s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:06:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" released by "delete_snapshot" :: held 3.322s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:06:03 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Created reservations ['6f9d9a22-dc5e-4380-8776-8dc375df2e81', 'a5704467-1c03-4173-977f-ef2d7e807e43', '3c6df5eb-87bf-42b9-9e40-9d2d7461656e', 'a2679f60-2472-405e-8621-bcaec2dff7a3'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:06:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Delete snapshot completed successfully.
Jul 06 21:06:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bc4d96f-6e2e-4470-8047-6cbeeb27cb7e tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-d9a46aa3-fc89-4b0b-9aaf-7a5c95d8f80c-delete_snapshot" released by "delete_snapshot" :: held 3.563s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:06:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:06:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:06:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-quobyte-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:06:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:06:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[469d1ae7-70e0-4298-8ecb-d6d40a5e832f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:06:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:04 devstack sudo[103906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7
Jul 06 21:06:04 devstack sudo[103906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:05 devstack sudo[103906]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" returned: 0 in 0.790s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:05 devstack sudo[103916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7
Jul 06 21:06:05 devstack sudo[103916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:06 devstack sudo[103916]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" returned: 0 in 0.654s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7" released by "delete_volume" :: held 1.547s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Created reservations ['d35ed2ad-52eb-4a69-b008-be5479ab46db', 'e5194754-dea4-422a-b556-ac5a3ff62823', 'ee36857d-d4c4-4d79-b658-b9245cfc82d9', 'c70b0afe-e405-4ae3-b37d-33d67e68d09e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:06 devstack sudo[103919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:06:06 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-00037bc5-e5a7-4018-ba80-d3f0692ec423-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-00037bc5-e5a7-4018-ba80-d3f0692ec423-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "cinder-quobyte-00037bc5-e5a7-4018-ba80-d3f0692ec423" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-00037bc5-e5a7-4018-ba80-d3f0692ec423" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[349dfec6-0ba7-42c5-8c7d-535e7c8dae07]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:06:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:07 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.645s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:07 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:06:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Deleted volume successfully.
Jul 06 21:06:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-700b35fa-1c12-44f3-8949-ff96e432cb43 tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-a8e21a6d-63f5-4091-82b5-21a1a1c2fca7-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:06:07 devstack sudo[103922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423
Jul 06 21:06:07 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:07 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423" returned: 0 in 0.757s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:07 devstack sudo[103927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423
Jul 06 21:06:07 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:08 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-00037bc5-e5a7-4018-ba80-d3f0692ec423" returned: 0 in 0.844s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-quobyte-00037bc5-e5a7-4018-ba80-d3f0692ec423" released by "delete_volume" :: held 1.656s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Created reservations ['76b51203-414d-4e72-bb23-9fac2d47dfae', '572f4ebe-d336-4a97-ba4f-6531d373da95', '122bb324-f86e-452e-8804-6e8c00ee7640', '22b9b41e-a979-49fc-811e-b12106f934fa'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:06:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:08 devstack sudo[103978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:06:08 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:09 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.657s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:09 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:06:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Deleted volume successfully.
Jul 06 21:06:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7d73c7ed-4a18-4dd8-84ee-76b867ecb88b tempest-VolumeDependencyTests-1251599722 None] Lock "cinder-00037bc5-e5a7-4018-ba80-d3f0692ec423-delete_volume" released by "delete_volume" :: held 2.590s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:06:18 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=27,cinder:UPDATE=30,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:06:19 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=32,cinder:INSERT=8,cinder:SELECT=24,cinder:DELETE=2 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:37 devstack sudo[104081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:06:37 devstack sudo[104081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-dbe2bfb7-0149-4d80-b905-e7af97104ede req-2c34ea8d-fefc-4b67-bf42-3ce31f2065ab tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-dbe2bfb7-0149-4d80-b905-e7af97104ede req-2c34ea8d-fefc-4b67-bf42-3ce31f2065ab tempest-TestStampPattern-1857016485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4691a3-e0c0-49d1-9fcf-788e7fce7164]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:06:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-dbe2bfb7-0149-4d80-b905-e7af97104ede req-2c34ea8d-fefc-4b67-bf42-3ce31f2065ab tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:38 devstack sudo[104091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:06:38 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:38 devstack sudo[104081]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:06:38 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-dbe2bfb7-0149-4d80-b905-e7af97104ede req-2c34ea8d-fefc-4b67-bf42-3ce31f2065ab tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 0.776s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-dbe2bfb7-0149-4d80-b905-e7af97104ede req-2c34ea8d-fefc-4b67-bf42-3ce31f2065ab tempest-TestStampPattern-1857016485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.794s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:06:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-dbe2bfb7-0149-4d80-b905-e7af97104ede req-2c34ea8d-fefc-4b67-bf42-3ce31f2065ab tempest-TestStampPattern-1857016485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-17d83376-0b46-4523-9c5a-3e6404ac556e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'aae0f7e6-f972-41d3-9d58-59a1c15b81db', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:06:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-dbe2bfb7-0149-4d80-b905-e7af97104ede req-2c34ea8d-fefc-4b67-bf42-3ce31f2065ab tempest-TestStampPattern-1857016485 None] attachment_update completed successfully.
Jul 06 21:06:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-1799798d-0d17-46f6-93fd-bf3319665da9 req-8a8c115b-c2c0-48f8-8655-6768214c6455 tempest-TestStampPattern-1857016485 None] Terminate volume connection completed successfully.
Jul 06 21:06:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-1799798d-0d17-46f6-93fd-bf3319665da9 req-8a8c115b-c2c0-48f8-8655-6768214c6455 tempest-TestStampPattern-1857016485 None] Deleting attachment aae0f7e6-f972-41d3-9d58-59a1c15b81db. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:06:48 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:06:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:06:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:06:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Creating offline snapshot dc876901-4c6e-4478-a3cf-06c49194a1d5 of volume 17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:06:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d6c078-e745-4362-8fc1-e45ea69569b3]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:06:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:49 devstack sudo[104534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:06:49 devstack sudo[104534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:49 devstack sudo[104534]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 0.767s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:49 devstack sudo[104539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 1G
Jul 06 21:06:49 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:50 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 1G" returned: 0 in 0.783s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d83376-0b46-4523-9c5a-3e6404ac556e -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:50 devstack sudo[104544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d83376-0b46-4523-9c5a-3e6404ac556e -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5
Jul 06 21:06:50 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:51 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17d83376-0b46-4523-9c5a-3e6404ac556e -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5" returned: 0 in 0.713s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:51 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 is being set with open permissions: ugo+rw
Jul 06 21:06:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:51 devstack sudo[104549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5
Jul 06 21:06:51 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:52 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5" returned: 0 in 0.650s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:52 devstack sudo[104552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.info
Jul 06 21:06:52 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:52 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.info" returned: 0 in 0.656s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:52 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.info is being set with open permissions: ugo+rw
Jul 06 21:06:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:06:52 devstack sudo[104555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.info
Jul 06 21:06:52 devstack sudo[104555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:06:53 devstack sudo[104555]: pam_unix(sudo:session): session closed for user root
Jul 06 21:06:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.info" returned: 0 in 0.655s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:06:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.305s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:06:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8d6efac5-3470-46c9-b547-c9228753f15a tempest-TestStampPattern-1857016485 None] Create snapshot completed successfully
Jul 06 21:07:03 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=5,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Flow 'volume_create_manager' (e978b944-ae8c-4625-bc3e-4c7d9c0de6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0fa7aa-1ecd-4ad1-ae11-1885c2b01092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0fa7aa-1ecd-4ad1-ae11-1885c2b01092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:07:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1639943537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8629ad7-d54b-4b54-b56d-9daf48f006d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ae021dd4a5e49908e51ef59c93daec3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc876901-4c6e-4478-a3cf-06c49194a1d5,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:04Z,use_quota=True,user_id='dafa166452ee46b2a5f762097b977a0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f891cbf5-0743-4990-b175-0e8772784bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f891cbf5-0743-4990-b175-0e8772784bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be146757-658b-4819-af74-a87fe3b29379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be146757-658b-4819-af74-a87fe3b29379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f8629ad7-d54b-4b54-b56d-9daf48f006d0', 'volume_name': 'volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0', 'volume_size': 1, 'snapshot_id': 'dc876901-4c6e-4478-a3cf-06c49194a1d5'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44a2783-175c-4fd0-ab45-d1cc26f767a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44a2783-175c-4fd0-ab45-d1cc26f767a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f43f7e-9d32-4552-b4a4-191abedae9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:07:04 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Volume f8629ad7-d54b-4b54-b56d-9daf48f006d0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0', 'volume_size': 1, 'snapshot_id': 'dc876901-4c6e-4478-a3cf-06c49194a1d5'}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-quobyte-dc876901-4c6e-4478-a3cf-06c49194a1d5-f8629ad7-d54b-4b54-b56d-9daf48f006d0" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-dc876901-4c6e-4478-a3cf-06c49194a1d5-f8629ad7-d54b-4b54-b56d-9daf48f006d0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Creating volume f8629ad7-d54b-4b54-b56d-9daf48f006d0 from snapshot dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-quobyte-f8629ad7-d54b-4b54-b56d-9daf48f006d0" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-f8629ad7-d54b-4b54-b56d-9daf48f006d0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] snapshot: dc876901-4c6e-4478-a3cf-06c49194a1d5, volume: f8629ad7-d54b-4b54-b56d-9daf48f006d0,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c82959-1eca-4866-b503-6d99e0225291]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:07:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:07:04 devstack sudo[104590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5
Jul 06 21:07:04 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:07:05 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5" returned: 0 in 0.852s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17d83376-0b46-4523-9c5a-3e6404ac556e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc14e34-2b56-444d-91c5-8b37b51fa2d2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:07:05 devstack sudo[104600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:07:05 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:07:05 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 0.805s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 21:07:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:07:05 devstack sudo[104605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0
Jul 06 21:07:05 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:07:10 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root
Jul 06 21:07:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0" returned: 0 in 5.082s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:07:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa16dc6-2d65-4031-860b-98b2fd81a439]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:07:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:07:11 devstack sudo[104619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:07:11 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:07:12 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root
Jul 06 21:07:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 1.078s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:07:12 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e, size 1024.00 MB, duration 5.08 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:07:12 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Converted 1024.00 MB image at 201.43 MB/s
Jul 06 21:07:12 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 is being set with open permissions: ugo+rw
Jul 06 21:07:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:07:12 devstack sudo[104626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0
Jul 06 21:07:12 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:07:12 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root
Jul 06 21:07:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0" returned: 0 in 0.887s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:07:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-f8629ad7-d54b-4b54-b56d-9daf48f006d0" released by "_copy_volume_from_snapshot" :: held 8.804s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:07:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-dc876901-4c6e-4478-a3cf-06c49194a1d5-f8629ad7-d54b-4b54-b56d-9daf48f006d0" released by "_create_volume_from_snapshot" :: held 8.836s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:07:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.853s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:07:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f43f7e-9d32-4552-b4a4-191abedae9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0', 'volume_size': 1, 'snapshot_id': 'dc876901-4c6e-4478-a3cf-06c49194a1d5'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:07:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3ea9f3-3dd9-4e03-aca1-9801b08e3429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:07:13 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Volume volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 (f8629ad7-d54b-4b54-b56d-9daf48f006d0): created successfully
Jul 06 21:07:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb3ea9f3-3dd9-4e03-aca1-9801b08e3429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:07:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Flow 'volume_create_manager' (e978b944-ae8c-4625-bc3e-4c7d9c0de6a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:07:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3cb26287-94dc-4981-b671-f4c6e8d89be9 tempest-TestStampPattern-1857016485 None] Created volume successfully.
Jul 06 21:07:22 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:07:23 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=13,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:07:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:07:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:07:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:07:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:07:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:07:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:07:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:07:37 devstack sudo[104770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:07:37 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:07:38 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root
Jul 06 21:07:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:07:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:07:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:07:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:07:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:07:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c9cafa22-cd7a-4ced-be40-9a020562d858 req-bfeb13fa-9861-458a-bc53-ec7662cddf7e tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:07:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c9cafa22-cd7a-4ced-be40-9a020562d858 req-bfeb13fa-9861-458a-bc53-ec7662cddf7e tempest-TestStampPattern-1857016485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:07:47 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb96e0a1-3b2d-4f8d-820f-27e4f69dda8a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:07:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c9cafa22-cd7a-4ced-be40-9a020562d858 req-bfeb13fa-9861-458a-bc53-ec7662cddf7e tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:07:48 devstack sudo[104792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0
Jul 06 21:07:48 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:07:48 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root
Jul 06 21:07:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [req-c9cafa22-cd7a-4ced-be40-9a020562d858 req-bfeb13fa-9861-458a-bc53-ec7662cddf7e tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0" returned: 0 in 0.743s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:07:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [req-c9cafa22-cd7a-4ced-be40-9a020562d858 req-bfeb13fa-9861-458a-bc53-ec7662cddf7e tempest-TestStampPattern-1857016485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:07:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-c9cafa22-cd7a-4ced-be40-9a020562d858 req-bfeb13fa-9861-458a-bc53-ec7662cddf7e tempest-TestStampPattern-1857016485 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2', 'name': 'volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31ab72be-f46f-4d69-b16d-f09eef8135bb', 'enforce_multipath': True} {{(pid=86721) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Jul 06 21:07:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-c9cafa22-cd7a-4ced-be40-9a020562d858 req-bfeb13fa-9861-458a-bc53-ec7662cddf7e tempest-TestStampPattern-1857016485 None] attachment_update completed successfully.
Jul 06 21:07:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [req-9e3e967e-a85e-48bb-94c9-80a4d76ae855 req-b366b577-08db-4688-b7fb-08afb6cfa224 tempest-TestStampPattern-1857016485 None] Terminate volume connection completed successfully.
Jul 06 21:07:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [req-9e3e967e-a85e-48bb-94c9-80a4d76ae855 req-b366b577-08db-4688-b7fb-08afb6cfa224 tempest-TestStampPattern-1857016485 None] Deleting attachment 31ab72be-f46f-4d69-b16d-f09eef8135bb. {{(pid=86721) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Jul 06 21:08:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-f8629ad7-d54b-4b54-b56d-9daf48f006d0-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Lock "cinder-f8629ad7-d54b-4b54-b56d-9daf48f006d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-quobyte-f8629ad7-d54b-4b54-b56d-9daf48f006d0" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-f8629ad7-d54b-4b54-b56d-9daf48f006d0" acquired by "delete_volume" :: waited 0.013s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[def2d03b-c926-4f3b-b63f-7096ae9bc138]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:05 devstack sudo[105255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0
Jul 06 21:08:05 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:06 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0" returned: 0 in 0.741s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:06 devstack sudo[105260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0
Jul 06 21:08:06 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:06 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f8629ad7-d54b-4b54-b56d-9daf48f006d0" returned: 0 in 0.699s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-f8629ad7-d54b-4b54-b56d-9daf48f006d0" released by "delete_volume" :: held 1.477s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Created reservations ['5671cd57-6dc5-449b-8655-cfe8b6e77568', '444ebbde-e43f-477f-bf2d-3985dcdacedc', '1e4f70fa-57c6-487b-b3be-6b88c8e0460a', '510d81a2-499f-4b8e-9f1b-65e2f1f5d1a9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:06 devstack sudo[105263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:08:06 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:07 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.629s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:08:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Deleted volume successfully.
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-62d53fe7-96a3-4847-be7f-181f22af8c1a tempest-TestStampPattern-1857016485 None] Lock "cinder-f8629ad7-d54b-4b54-b56d-9daf48f006d0-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-dc876901-4c6e-4478-a3cf-06c49194a1d5-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Lock "cinder-dc876901-4c6e-4478-a3cf-06c49194a1d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-quobyte-17d83376-0b46-4523-9c5a-3e6404ac556e" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-17d83376-0b46-4523-9c5a-3e6404ac556e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-quobyte-dc876901-4c6e-4478-a3cf-06c49194a1d5" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-dc876901-4c6e-4478-a3cf-06c49194a1d5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Deleting offline snapshot dc876901-4c6e-4478-a3cf-06c49194a1d5 of volume 17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] snapshot_file for this snap is: volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b24c93-ef96-4ce6-af02-63656c55d41e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:07 devstack sudo[105266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5
Jul 06 21:08:07 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:08 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5" returned: 0 in 0.760s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17d83376-0b46-4523-9c5a-3e6404ac556e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:08:08 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5d8287-9b6c-4b22-b786-03b402b85b2b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:08 devstack sudo[105272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:08:08 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:09 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 0.729s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:09 devstack sudo[105277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5
Jul 06 21:08:09 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:10 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5" returned: 0 in 0.708s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:10 devstack sudo[105282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5
Jul 06 21:08:10 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:10 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e.dc876901-4c6e-4478-a3cf-06c49194a1d5" returned: 0 in 0.641s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-dc876901-4c6e-4478-a3cf-06c49194a1d5" released by "_delete_snapshot" :: held 2.941s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-17d83376-0b46-4523-9c5a-3e6404ac556e" released by "delete_snapshot" :: held 2.967s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:10 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Created reservations ['8db3493a-2e06-4be7-8b0d-d3fbad83f017', 'cf66ad64-a148-4a97-b6d9-427f769791ee', '03b446f3-14af-4a32-95b9-bcc8cd4d3fc0', '4fc0e039-ce17-4967-808d-14577c0498c2'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:08:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Delete snapshot completed successfully.
Jul 06 21:08:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-7566dce8-aa05-4bc2-b383-5047835a8644 tempest-TestStampPattern-1857016485 None] Lock "cinder-dc876901-4c6e-4478-a3cf-06c49194a1d5-delete_snapshot" released by "delete_snapshot" :: held 3.109s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-17d83376-0b46-4523-9c5a-3e6404ac556e-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Lock "cinder-17d83376-0b46-4523-9c5a-3e6404ac556e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Acquiring lock "cinder-quobyte-17d83376-0b46-4523-9c5a-3e6404ac556e" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-17d83376-0b46-4523-9c5a-3e6404ac556e" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:19 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6d3dfb-1b30-490f-b980-8063c587fb3c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:19 devstack sudo[105351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:08:19 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:19 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 0.743s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:19 devstack sudo[105356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e
Jul 06 21:08:19 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:20 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-17d83376-0b46-4523-9c5a-3e6404ac556e" returned: 0 in 0.672s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Lock "cinder-quobyte-17d83376-0b46-4523-9c5a-3e6404ac556e" released by "delete_volume" :: held 1.475s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Created reservations ['63d046b0-e99f-4eb8-b871-bb51ede6e245', '9735b716-50d3-4322-bc65-db7fa933ee4f', '5ed7aa4e-8724-4a61-8f62-186fbe0825ee', 'e1328071-cc33-448d-aef3-0371076d92f4'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:20 devstack sudo[105359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:08:20 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:21 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.688s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:21 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:08:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Deleted volume successfully.
Jul 06 21:08:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0a8d5952-d317-4728-ad7c-9ee4d6bdd160 tempest-TestStampPattern-1857016485 None] Lock "cinder-17d83376-0b46-4523-9c5a-3e6404ac556e-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:30 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:08:31 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=20,cinder:UPDATE=20,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Flow 'volume_create_manager' (d940d0a4-303e-4044-8b31-ead39b4b3310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8726c31c-a0c7-4850-b8c0-76042ececc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8726c31c-a0c7-4850-b8c0-76042ececc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381351c3-12c5-48e2-83db-777a37b955d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee9290f7be4de0bb332828f8f54b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:35Z,use_quota=True,user_id='60776d8e40f14c0faa2851a2f184db94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1d25e23-d0c5-459d-b406-0a86a8fad9f8),volume_type_id=d1d25e23-d0c5-459d-b406-0a86a8fad9f8)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b9261-1c73-4f3e-84b2-347756ef6f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (488b9261-1c73-4f3e-84b2-347756ef6f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c41ce35-868b-4874-a904-4e03ad829e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:34 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c41ce35-868b-4874-a904-4e03ad829e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '381351c3-12c5-48e2-83db-777a37b955d7', 'volume_name': 'volume-381351c3-12c5-48e2-83db-777a37b955d7', 'volume_size': 1, 'image_id': '97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44b2733ea5fe8f6536340eacd22d0bad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01ee9290f7be4de0bb332828f8f54b8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d554165f9eec7718981feb0451ae34be0fdad85801a98b7350af5941255610aca72a168087d1b6eac7d2a22a7a9f0068b95e73ef1e5b23c6d19b74da3c57820', 'id': '97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'created_at': datetime.datetime(2026, 7, 6, 19, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 8, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713deca6bf20>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18297e8-5b54-42d0-b6f1-9c25368cb48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c18297e8-5b54-42d0-b6f1-9c25368cb48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76de6582-f0f4-456c-a5a8-3e4ad387a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:35 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Volume 381351c3-12c5-48e2-83db-777a37b955d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-381351c3-12c5-48e2-83db-777a37b955d7', 'volume_size': 1, 'image_id': '97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44b2733ea5fe8f6536340eacd22d0bad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01ee9290f7be4de0bb332828f8f54b8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d554165f9eec7718981feb0451ae34be0fdad85801a98b7350af5941255610aca72a168087d1b6eac7d2a22a7a9f0068b95e73ef1e5b23c6d19b74da3c57820', 'id': '97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'created_at': datetime.datetime(2026, 7, 6, 19, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 8, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713deca6bf20>}
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Trying to clone 381351c3-12c5-48e2-83db-777a37b955d7 from image 97bb9681-ec2c-41dc-8a2f-d4c662681f53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 21:08:35 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e59633-c72b-4786-83b6-dabceabaae0f]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:35 devstack sudo[105373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD
Jul 06 21:08:35 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:36 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD" returned: 0 in 0.737s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:36 devstack sudo[105377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD
Jul 06 21:08:36 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:36 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD" returned: 1 in 0.729s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:08:36 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Temporary image 97bb9681-ec2c-41dc-8a2f-d4c662681f53 is fetched for user 60776d8e40f14c0faa2851a2f184db94. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 21:08:36 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab70a1-f733-4d95-bd71-b43fdbc547a3]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:37 devstack sudo[105382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD
Jul 06 21:08:37 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:37 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD" returned: 0 in 0.705s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:37 devstack sudo[105387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:08:37 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:37 devstack sudo[105386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD
Jul 06 21:08:37 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:38 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.691s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:08:38 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD" returned: 1 in 0.745s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381351c3-12c5-48e2-83db-777a37b955d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ee9290f7be4de0bb332828f8f54b8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:35Z,use_quota=True,user_id='60776d8e40f14c0faa2851a2f184db94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1d25e23-d0c5-459d-b406-0a86a8fad9f8),volume_type_id=d1d25e23-d0c5-459d-b406-0a86a8fad9f8)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Creating volume 381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:08:38 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:08:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:38 devstack sudo[105395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 1073741824
Jul 06 21:08:38 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:39 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 1073741824" returned: 0 in 0.827s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:39 devstack sudo[105402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7
Jul 06 21:08:39 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:39 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7" returned: 0 in 0.631s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Attempting download of 97bb9681-ec2c-41dc-8a2f-d4c662681f53 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'metadata': {}}])) to volume 381351c3-12c5-48e2-83db-777a37b955d7. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[051aa4ac-93df-41d3-bde5-1db475c66101]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bb9681-ec2c-41dc-8a2f-d4c662681f53_1zzrxcou {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:40 devstack sudo[105405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bb9681-ec2c-41dc-8a2f-d4c662681f53_1zzrxcou
Jul 06 21:08:40 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:40 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_97bb9681-ec2c-41dc-8a2f-d4c662681f53_1zzrxcou" returned: 0 in 0.736s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bb9681-ec2c-41dc-8a2f-d4c662681f53_1zzrxcou {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:40 devstack sudo[105409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bb9681-ec2c-41dc-8a2f-d4c662681f53_1zzrxcou
Jul 06 21:08:40 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:41 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bb9681-ec2c-41dc-8a2f-d4c662681f53_1zzrxcou" returned: 1 in 0.727s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_97bb9681-ec2c-41dc-8a2f-d4c662681f53_1zzrxcou' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:08:41 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52f537e-0dfc-42c5-ae7a-8dd812a1e37e]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:41 devstack sudo[105415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD
Jul 06 21:08:41 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:42 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD" returned: 0 in 0.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:42 devstack sudo[105419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD
Jul 06 21:08:42 devstack sudo[105419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:42 devstack sudo[105419]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD" returned: 1 in 0.703s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:08:42 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] 97bb9681-ec2c-41dc-8a2f-d4c662681f53 was raw, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 21:08:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:42 devstack sudo[105424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7
Jul 06 21:08:42 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:43 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:43 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_97bb9681-ec2c-41dc-8a2f-d4c662681f53_6n9udjw0devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:08:43 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 21:08:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:43 devstack sudo[105429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 1G
Jul 06 21:08:43 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:44 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 1G" returned: 0 in 0.663s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:44 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea45458e-3d2e-4c8d-9f4c-3954080d38c7]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:44 devstack sudo[105434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7
Jul 06 21:08:44 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:44 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7" returned: 0 in 0.733s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:45 devstack sudo[105438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7
Jul 06 21:08:45 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:45 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7" returned: 1 in 0.800s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Downloaded image 97bb9681-ec2c-41dc-8a2f-d4c662681f53 ((None, [{'url': 'file:///opt/stack/data/glance/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'metadata': {}}])) to volume 381351c3-12c5-48e2-83db-777a37b955d7 successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Temporary image 97bb9681-ec2c-41dc-8a2f-d4c662681f53 for user 60776d8e40f14c0faa2851a2f184db94 is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Marking volume 381351c3-12c5-48e2-83db-777a37b955d7 as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Copying metadata from image 97bb9681-ec2c-41dc-8a2f-d4c662681f53 to 381351c3-12c5-48e2-83db-777a37b955d7. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Creating volume glance metadata for volume 381351c3-12c5-48e2-83db-777a37b955d7 backed by image 97bb9681-ec2c-41dc-8a2f-d4c662681f53 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '44b2733ea5fe8f6536340eacd22d0bad', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76de6582-f0f4-456c-a5a8-3e4ad387a397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381351c3-12c5-48e2-83db-777a37b955d7', 'volume_size': 1, 'image_id': '97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '44b2733ea5fe8f6536340eacd22d0bad', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '01ee9290f7be4de0bb332828f8f54b8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d554165f9eec7718981feb0451ae34be0fdad85801a98b7350af5941255610aca72a168087d1b6eac7d2a22a7a9f0068b95e73ef1e5b23c6d19b74da3c57820', 'id': '97bb9681-ec2c-41dc-8a2f-d4c662681f53', 'created_at': datetime.datetime(2026, 7, 6, 19, 8, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 8, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/97bb9681-ec2c-41dc-8a2f-d4c662681f53/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713deca6bf20>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e30197f-e3e4-4c95-8bb7-e42b90c76d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Volume volume-381351c3-12c5-48e2-83db-777a37b955d7 (381351c3-12c5-48e2-83db-777a37b955d7): created successfully
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e30197f-e3e4-4c95-8bb7-e42b90c76d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Flow 'volume_create_manager' (d940d0a4-303e-4044-8b31-ead39b4b3310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:08:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e53dd6a0-76db-4a21-93fc-2c2ae4a680d8 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Created volume successfully.
Jul 06 21:08:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Acquiring lock "cinder-381351c3-12c5-48e2-83db-777a37b955d7-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "cinder-381351c3-12c5-48e2-83db-777a37b955d7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Acquiring lock "cinder-quobyte-381351c3-12c5-48e2-83db-777a37b955d7" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:08:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "cinder-quobyte-381351c3-12c5-48e2-83db-777a37b955d7" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:08:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d019cc2a-7d87-40ed-8acf-0742cb534090]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:46 devstack sudo[105443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7
Jul 06 21:08:46 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:47 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7" returned: 0 in 0.779s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:47 devstack sudo[105447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7
Jul 06 21:08:47 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:48 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7" returned: 1 in 0.784s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:08:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:48 devstack sudo[105453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7
Jul 06 21:08:48 devstack sudo[105453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:48 devstack sudo[105453]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-381351c3-12c5-48e2-83db-777a37b955d7" returned: 0 in 0.674s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "cinder-quobyte-381351c3-12c5-48e2-83db-777a37b955d7" released by "delete_volume" :: held 2.296s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:48 devstack cinder-volume[86721]: WARNING cinder.quota [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:08:48 devstack cinder-volume[86721]: WARNING cinder.quota [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Jul 06 21:08:48 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Created reservations ['756fd419-c4aa-44fa-938f-5602194587c3', '83fa6ed4-ecf8-4be8-a558-358e7469ce6f', 'eeb19f64-56bb-4147-bd8c-468ca342507f', '37b0d3f2-a386-4588-8119-8632fed18fd6'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:49 devstack sudo[105456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:08:49 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:49 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.644s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:08:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Deleted volume successfully.
Jul 06 21:08:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2fd919b0-39c7-4477-a2af-38f3465be7d1 tempest-VolumeAndVolumeTypeFromImageTest-1837325424 None] Lock "cinder-381351c3-12c5-48e2-83db-777a37b955d7-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Flow 'volume_create_manager' (77d0010d-370c-4ee8-9e5a-d94c86de89ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbab39d-d04e-447a-b02a-4b6ab7126ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cbab39d-d04e-447a-b02a-4b6ab7126ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a0281e-3e49-4c27-8617-ed5d5c0be383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579415188cea47f396097cf53dd86090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:54Z,use_quota=True,user_id='3cd62e842e0d405491ef0f9fca4ef90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05012092-cda4-40b9-8897-17c5ca608869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05012092-cda4-40b9-8897-17c5ca608869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4126e815-cb0f-4541-b8a2-0295e28938b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4126e815-cb0f-4541-b8a2-0295e28938b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1a0281e-3e49-4c27-8617-ed5d5c0be383', 'volume_name': 'volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1881de0f-a9fc-4d91-8426-af0d1b006e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1881de0f-a9fc-4d91-8426-af0d1b006e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a3082e-3212-4c37-9aba-38b26b2fddfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:54 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Volume e1a0281e-3e49-4c27-8617-ed5d5c0be383: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383', 'volume_size': 1}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:08:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1a0281e-3e49-4c27-8617-ed5d5c0be383,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579415188cea47f396097cf53dd86090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:54Z,use_quota=True,user_id='3cd62e842e0d405491ef0f9fca4ef90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Creating volume e1a0281e-3e49-4c27-8617-ed5d5c0be383 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:08:54 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:08:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:54 devstack sudo[105459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383 1073741824
Jul 06 21:08:54 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:55 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383 1073741824" returned: 0 in 0.876s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:55 devstack sudo[105464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383
Jul 06 21:08:55 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:55 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383" returned: 0 in 0.655s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a3082e-3212-4c37-9aba-38b26b2fddfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59acf5a2-a9ea-4d61-af4f-46e48492e4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Volume volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383 (e1a0281e-3e49-4c27-8617-ed5d5c0be383): created successfully
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59acf5a2-a9ea-4d61-af4f-46e48492e4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Flow 'volume_create_manager' (77d0010d-370c-4ee8-9e5a-d94c86de89ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:08:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7f2880a8-90dc-4a87-9779-f32da22dbbcf tempest-CinderUnicodeTest-1550894506 None] Created volume successfully.
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Flow 'volume_create_manager' (61948bb1-1c1d-4f64-8c0b-05b4e65f9d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a79bcf-c552-4c5e-b9b0-bb141e6ccb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a79bcf-c552-4c5e-b9b0-bb141e6ccb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:08:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-532627870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ba40bd-21c4-440f-826d-b99fe1ee7878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579415188cea47f396097cf53dd86090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:57Z,use_quota=True,user_id='3cd62e842e0d405491ef0f9fca4ef90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c932a1-9916-407c-8d13-14b46f9183c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c932a1-9916-407c-8d13-14b46f9183c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f284d52-f6f3-426d-a4e0-b57f99796398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f284d52-f6f3-426d-a4e0-b57f99796398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ba40bd-21c4-440f-826d-b99fe1ee7878', 'volume_name': 'volume-35ba40bd-21c4-440f-826d-b99fe1ee7878', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedb9580-12d4-49b8-88d1-2243becb6888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eedb9580-12d4-49b8-88d1-2243becb6888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5f8138-cceb-4f29-b469-6b38b7f8d1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:56 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Volume 35ba40bd-21c4-440f-826d-b99fe1ee7878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ba40bd-21c4-440f-826d-b99fe1ee7878', 'volume_size': 1}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:08:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-532627870',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35ba40bd-21c4-440f-826d-b99fe1ee7878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='579415188cea47f396097cf53dd86090',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:57Z,use_quota=True,user_id='3cd62e842e0d405491ef0f9fca4ef90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Creating volume 35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:08:56 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:08:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:56 devstack sudo[105468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 1073741824
Jul 06 21:08:56 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:57 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 1073741824" returned: 0 in 0.849s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:57 devstack sudo[105474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878
Jul 06 21:08:57 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:58 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878" returned: 0 in 0.641s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:08:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:08:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5f8138-cceb-4f29-b469-6b38b7f8d1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ba40bd-21c4-440f-826d-b99fe1ee7878', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601aa77c-c5db-4829-9df6-f0834934bd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:08:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Volume volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 (35ba40bd-21c4-440f-826d-b99fe1ee7878): created successfully
Jul 06 21:08:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (601aa77c-c5db-4829-9df6-f0834934bd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:08:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Flow 'volume_create_manager' (61948bb1-1c1d-4f64-8c0b-05b4e65f9d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:08:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-da2e8360-a3a2-4233-8c5c-e1101a66ada1 tempest-CinderUnicodeTest-1550894506 None] Created volume successfully.
Jul 06 21:08:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:08:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:08:59 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Creating offline snapshot d867195c-7529-4121-a9e6-ff5ccdaf2c2f of volume 35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:08:59 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7350369-ff9c-4cf8-a578-b1a88aa19d88]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:08:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:59 devstack sudo[105478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878
Jul 06 21:08:59 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:08:59 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root
Jul 06 21:08:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878" returned: 0 in 0.753s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:08:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:08:59 devstack sudo[105483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f 1G
Jul 06 21:08:59 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:00 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f 1G" returned: 0 in 0.792s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:00 devstack sudo[105488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f
Jul 06 21:09:00 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:01 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f" returned: 0 in 0.777s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:01 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f is being set with open permissions: ugo+rw
Jul 06 21:09:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:01 devstack sudo[105493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f
Jul 06 21:09:01 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:02 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f" returned: 0 in 0.648s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:02 devstack sudo[105496]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.info
Jul 06 21:09:02 devstack sudo[105496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:02 devstack sudo[105496]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.info" returned: 0 in 0.664s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:02 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.info is being set with open permissions: ugo+rw
Jul 06 21:09:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:02 devstack sudo[105499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.info
Jul 06 21:09:02 devstack sudo[105499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:03 devstack sudo[105499]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.info" returned: 0 in 0.676s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.395s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6fe1b125-1280-49fe-b301-9c38700770db tempest-CinderUnicodeTest-1550894506 None] Create snapshot completed successfully
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "cinder-d867195c-7529-4121-a9e6-ff5ccdaf2c2f-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-d867195c-7529-4121-a9e6-ff5ccdaf2c2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "cinder-quobyte-35ba40bd-21c4-440f-826d-b99fe1ee7878" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-35ba40bd-21c4-440f-826d-b99fe1ee7878" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "cinder-quobyte-d867195c-7529-4121-a9e6-ff5ccdaf2c2f" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-d867195c-7529-4121-a9e6-ff5ccdaf2c2f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Deleting offline snapshot d867195c-7529-4121-a9e6-ff5ccdaf2c2f of volume 35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] snapshot_file for this snap is: volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d735bdf-d6a9-4c81-a2f3-7cc6d3772373]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:04 devstack sudo[105502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f
Jul 06 21:09:04 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:05 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f" returned: 0 in 0.814s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ba40bd-21c4-440f-826d-b99fe1ee7878(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:09:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0796ff08-4007-449d-9af0-9b6d4d3e4583]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:05 devstack sudo[105507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878
Jul 06 21:09:05 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:05 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878" returned: 0 in 0.735s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:05 devstack sudo[105512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f
Jul 06 21:09:05 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:06 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f" returned: 0 in 0.704s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:06 devstack sudo[105517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f
Jul 06 21:09:06 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:07 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878.d867195c-7529-4121-a9e6-ff5ccdaf2c2f" returned: 0 in 0.614s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-d867195c-7529-4121-a9e6-ff5ccdaf2c2f" released by "_delete_snapshot" :: held 2.970s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-35ba40bd-21c4-440f-826d-b99fe1ee7878" released by "delete_snapshot" :: held 2.996s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:07 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Created reservations ['db60b964-cef6-4165-bff0-35b7e14061c7', '794e88e3-bd3b-4f49-a1ee-b005e4ec2bb6', '0242e4b6-5cc2-415e-baa4-6ffb5ef84cfc', 'b5ac0952-f206-44db-bef3-e1626507469c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:09:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Delete snapshot completed successfully.
Jul 06 21:09:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-0d91c699-0573-44fa-bd37-8ae9ce001b23 tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-d867195c-7529-4121-a9e6-ff5ccdaf2c2f-delete_snapshot" released by "delete_snapshot" :: held 3.142s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "cinder-35ba40bd-21c4-440f-826d-b99fe1ee7878-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-35ba40bd-21c4-440f-826d-b99fe1ee7878-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "cinder-quobyte-35ba40bd-21c4-440f-826d-b99fe1ee7878" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-35ba40bd-21c4-440f-826d-b99fe1ee7878" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:08 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[512781ba-9af4-4eee-b7b4-8ed3964f6730]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:08 devstack sudo[105521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878
Jul 06 21:09:08 devstack sudo[105521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:09 devstack sudo[105521]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878" returned: 0 in 0.765s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:09 devstack sudo[105526]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878
Jul 06 21:09:09 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:09 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-35ba40bd-21c4-440f-826d-b99fe1ee7878" returned: 0 in 0.639s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-35ba40bd-21c4-440f-826d-b99fe1ee7878" released by "delete_volume" :: held 1.461s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Created reservations ['7bb26568-1666-49a9-8617-6b1ec7e24507', 'd8054dd7-1be0-4a89-a9e8-ce400c5e678a', '9e7ffd65-5ad5-4763-83e9-3bfa06c5cb4f', 'f7720014-217f-4da8-b2f9-ed867559c330'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:10 devstack sudo[105529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:09:10 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "cinder-e1a0281e-3e49-4c27-8617-ed5d5c0be383-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-e1a0281e-3e49-4c27-8617-ed5d5c0be383-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:10 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "cinder-quobyte-e1a0281e-3e49-4c27-8617-ed5d5c0be383" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.665s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:09:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Deleted volume successfully.
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-e1a0281e-3e49-4c27-8617-ed5d5c0be383" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e646aad3-06fd-4389-9960-0494a5814470]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9d00cff-bafe-42bd-9806-8a4e3aed539b tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-35ba40bd-21c4-440f-826d-b99fe1ee7878-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:10 devstack sudo[105532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383
Jul 06 21:09:10 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:11 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383" returned: 0 in 0.743s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:11 devstack sudo[105537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383
Jul 06 21:09:11 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:12 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e1a0281e-3e49-4c27-8617-ed5d5c0be383" returned: 0 in 0.708s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-quobyte-e1a0281e-3e49-4c27-8617-ed5d5c0be383" released by "delete_volume" :: held 1.495s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Created reservations ['65da9172-bb3a-43f7-86c8-a10e3bef1c7d', 'c6c8061b-477c-4db8-af85-9bd7f10d499b', '40a9917c-387d-41c7-9401-4320d0d2aef7', '9ea550ed-6040-46ed-b331-1d034caa9383'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:12 devstack sudo[105540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:09:12 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:13 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.644s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:13 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:09:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Deleted volume successfully.
Jul 06 21:09:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2bb51946-578f-4409-82f8-3ef9149378bd tempest-CinderUnicodeTest-1550894506 None] Lock "cinder-e1a0281e-3e49-4c27-8617-ed5d5c0be383-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Flow 'volume_create_manager' (c4bf2ccc-e6cc-4f40-8f9a-23f1502a573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6c113-4c39-4777-832a-34d8d32a8ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec6c113-4c39-4777-832a-34d8d32a8ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184615564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60307bb9-399d-43f3-98dc-f44eaa9aff31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6d94c944c044a3b4fc3073d9247fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:16Z,use_quota=True,user_id='154756487cad47cab03881d413469c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9cae79-b12a-4cc2-814d-567669f9e5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9cae79-b12a-4cc2-814d-567669f9e5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca497fa4-6124-4997-9fdd-061030f4241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca497fa4-6124-4997-9fdd-061030f4241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60307bb9-399d-43f3-98dc-f44eaa9aff31', 'volume_name': 'volume-60307bb9-399d-43f3-98dc-f44eaa9aff31', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be19cc4-cf30-40db-b71c-381390ea7839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7be19cc4-cf30-40db-b71c-381390ea7839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fe93c5-0bf5-4bb4-aa45-cf922e797e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:16 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Volume 60307bb9-399d-43f3-98dc-f44eaa9aff31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60307bb9-399d-43f3-98dc-f44eaa9aff31', 'volume_size': 1}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-184615564',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60307bb9-399d-43f3-98dc-f44eaa9aff31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6d94c944c044a3b4fc3073d9247fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:16Z,use_quota=True,user_id='154756487cad47cab03881d413469c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Creating volume 60307bb9-399d-43f3-98dc-f44eaa9aff31 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:16 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:16 devstack sudo[105580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31 1073741824
Jul 06 21:09:16 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:17 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31 1073741824" returned: 0 in 0.813s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:17 devstack sudo[105586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31
Jul 06 21:09:17 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:18 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31" returned: 0 in 0.742s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fe93c5-0bf5-4bb4-aa45-cf922e797e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60307bb9-399d-43f3-98dc-f44eaa9aff31', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d06a53-6267-49e7-b4d9-f6e6af26ac40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:18 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Volume volume-60307bb9-399d-43f3-98dc-f44eaa9aff31 (60307bb9-399d-43f3-98dc-f44eaa9aff31): created successfully
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d06a53-6267-49e7-b4d9-f6e6af26ac40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Flow 'volume_create_manager' (c4bf2ccc-e6cc-4f40-8f9a-23f1502a573a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-49a03bde-3466-40e7-a690-335b093517bd tempest-ProjectReaderTests-954160494 None] Created volume successfully.
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Acquiring lock "cinder-60307bb9-399d-43f3-98dc-f44eaa9aff31-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Lock "cinder-60307bb9-399d-43f3-98dc-f44eaa9aff31-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Acquiring lock "cinder-quobyte-60307bb9-399d-43f3-98dc-f44eaa9aff31" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Lock "cinder-quobyte-60307bb9-399d-43f3-98dc-f44eaa9aff31" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[777a9955-6200-4072-b7e7-a2a188ff4183]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:18 devstack sudo[105590]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31
Jul 06 21:09:18 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:19 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31" returned: 0 in 0.850s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:19 devstack sudo[105595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31
Jul 06 21:09:19 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:20 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-60307bb9-399d-43f3-98dc-f44eaa9aff31" returned: 0 in 0.632s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Lock "cinder-quobyte-60307bb9-399d-43f3-98dc-f44eaa9aff31" released by "delete_volume" :: held 1.521s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Created reservations ['bb0d5bad-27c2-4809-b06b-18c92db54687', 'be6c636c-f10f-443d-971a-5966ee8181d9', '983d9211-4a2f-4036-a40e-44533d9757c4', '0e3deb42-b35e-464d-85ea-61a84c05a6c9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:20 devstack sudo[105598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:09:20 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:21 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.644s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:09:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Deleted volume successfully.
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c7766587-eb37-44fb-8984-93cda8be4b0b tempest-ProjectReaderTests-954160494 None] Lock "cinder-60307bb9-399d-43f3-98dc-f44eaa9aff31-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Flow 'volume_create_manager' (9d101c17-e9b6-4122-8681-1f594ae4bb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d1e8db-8835-4ebc-a98f-d90dd1daf59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d1e8db-8835-4ebc-a98f-d90dd1daf59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960207364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06fd7ce-f805-414f-a1c3-4443b00c47a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6d94c944c044a3b4fc3073d9247fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:21Z,use_quota=True,user_id='154756487cad47cab03881d413469c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c793e155-1f04-481f-8972-9c34784b1d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c793e155-1f04-481f-8972-9c34784b1d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b10c5cf-208c-4fa9-b9d8-445466a25e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b10c5cf-208c-4fa9-b9d8-445466a25e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a06fd7ce-f805-414f-a1c3-4443b00c47a2', 'volume_name': 'volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4c9db6-a6ec-4e83-88b3-d45dd08cee4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd4c9db6-a6ec-4e83-88b3-d45dd08cee4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dac5ae5-39c7-46ed-88fe-482c2ab0f4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:21 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Volume a06fd7ce-f805-414f-a1c3-4443b00c47a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2', 'volume_size': 1}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960207364',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06fd7ce-f805-414f-a1c3-4443b00c47a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c6d94c944c044a3b4fc3073d9247fe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:21Z,use_quota=True,user_id='154756487cad47cab03881d413469c2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Creating volume a06fd7ce-f805-414f-a1c3-4443b00c47a2 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:21 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:21 devstack sudo[105601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2 1073741824
Jul 06 21:09:21 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:22 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2 1073741824" returned: 0 in 0.820s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:22 devstack sudo[105612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2
Jul 06 21:09:22 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:23 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2" returned: 0 in 0.681s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0dac5ae5-39c7-46ed-88fe-482c2ab0f4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e865521-8a6d-4a7f-9473-0851055c21b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Volume volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2 (a06fd7ce-f805-414f-a1c3-4443b00c47a2): created successfully
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e865521-8a6d-4a7f-9473-0851055c21b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Flow 'volume_create_manager' (9d101c17-e9b6-4122-8681-1f594ae4bb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-0b582012-2414-4996-9825-84783f26fc2d tempest-ProjectReaderTests-954160494 None] Created volume successfully.
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Acquiring lock "cinder-a06fd7ce-f805-414f-a1c3-4443b00c47a2-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Lock "cinder-a06fd7ce-f805-414f-a1c3-4443b00c47a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Acquiring lock "cinder-quobyte-a06fd7ce-f805-414f-a1c3-4443b00c47a2" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Lock "cinder-quobyte-a06fd7ce-f805-414f-a1c3-4443b00c47a2" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[28edaad1-fe11-4669-b6a2-7b4ddb9a1060]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:23 devstack sudo[105615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2
Jul 06 21:09:23 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:24 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2" returned: 0 in 0.820s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:24 devstack sudo[105620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2
Jul 06 21:09:24 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:25 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a06fd7ce-f805-414f-a1c3-4443b00c47a2" returned: 0 in 0.716s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Lock "cinder-quobyte-a06fd7ce-f805-414f-a1c3-4443b00c47a2" released by "delete_volume" :: held 1.577s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Created reservations ['1997eec1-3127-4b82-8c63-6f2b631fe95a', 'e9179442-2f5d-4c21-bb6e-3c87748c97a5', '1cd28146-ad6d-445a-a1ea-8535a85a7eea', '55a28fdd-2deb-46fe-8a3e-dfc7a9a9cafd'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:25 devstack sudo[105623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:09:25 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:25 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.712s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:25 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:09:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Deleted volume successfully.
Jul 06 21:09:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-901321ad-febb-494d-9114-bb46cc506d27 tempest-ProjectReaderTests-954160494 None] Lock "cinder-a06fd7ce-f805-414f-a1c3-4443b00c47a2-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:35 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=62,cinder:SELECT=54,cinder:INSERT=17,cinder:DELETE=5 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:09:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=47,cinder:INSERT=23,cinder:UPDATE=66,cinder:DELETE=6 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:09:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:09:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:37 devstack sudo[105652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:09:37 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:38 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.762s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:09:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:09:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:09:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (649f9158-b1b1-4d10-92ff-2106e72fc887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1158f7-c6e6-4c08-8915-c4f92fc781eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c1158f7-c6e6-4c08-8915-c4f92fc781eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815537912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cbdbc0-1c1f-419a-a466-e1aed95d715e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae2c15f-b62d-4ffd-bd42-41f7cd544579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ae2c15f-b62d-4ffd-bd42-41f7cd544579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9669a77f-6219-4f01-a896-4abf06b0dfa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9669a77f-6219-4f01-a896-4abf06b0dfa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30cbdbc0-1c1f-419a-a466-e1aed95d715e', 'volume_name': 'volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2f5930-d13e-4fb5-a14d-cdfade4313f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2f5930-d13e-4fb5-a14d-cdfade4313f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176a1020-aa68-4cd1-abcc-7c71942d35e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Volume 30cbdbc0-1c1f-419a-a466-e1aed95d715e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e', 'volume_size': 1}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-815537912',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30cbdbc0-1c1f-419a-a466-e1aed95d715e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:43Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Creating volume 30cbdbc0-1c1f-419a-a466-e1aed95d715e {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:43 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:43 devstack sudo[105673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e 1073741824
Jul 06 21:09:43 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (2f9f76d5-54cb-4018-bc63-e896aa77d7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43581627-b452-452c-a1f4-39d97e9e1316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43581627-b452-452c-a1f4-39d97e9e1316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247037150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8370161-4f25-4f15-a1bb-efdd30bc44af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276d3771-2bf1-49a5-951f-08e968e09ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (276d3771-2bf1-49a5-951f-08e968e09ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ce94d-2c94-4ac7-8eb7-964e7886b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141ce94d-2c94-4ac7-8eb7-964e7886b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8370161-4f25-4f15-a1bb-efdd30bc44af', 'volume_name': 'volume-a8370161-4f25-4f15-a1bb-efdd30bc44af', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0f5e9d-8211-4115-b20d-3fa69adaa687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b0f5e9d-8211-4115-b20d-3fa69adaa687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed823f3-59c4-494d-8d55-c6c87cf05575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume a8370161-4f25-4f15-a1bb-efdd30bc44af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8370161-4f25-4f15-a1bb-efdd30bc44af', 'volume_size': 1}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (8bddbaab-a8be-447e-bc01-4599efa8b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac24835d-b7bc-481a-b8f2-9dca0b38342d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac24835d-b7bc-481a-b8f2-9dca0b38342d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506827227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160cc636-81a6-45e7-b76b-d2db27363f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7437a1f-b75d-47c4-8c03-e2245ef3839a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7437a1f-b75d-47c4-8c03-e2245ef3839a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efd8a53-d519-41c1-a13d-f2116682e9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8efd8a53-d519-41c1-a13d-f2116682e9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160cc636-81a6-45e7-b76b-d2db27363f68', 'volume_name': 'volume-160cc636-81a6-45e7-b76b-d2db27363f68', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd366ab-ecaa-4ecd-a43c-0f177847c83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd366ab-ecaa-4ecd-a43c-0f177847c83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1aadf2-8ecd-49a3-bf6c-4e885f61a53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Volume 160cc636-81a6-45e7-b76b-d2db27363f68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160cc636-81a6-45e7-b76b-d2db27363f68', 'volume_size': 1}
Jul 06 21:09:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (46777ace-c7f9-4188-8502-ca9935c5a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb661e2-1ce7-4261-b087-868264fd38b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6eb661e2-1ce7-4261-b087-868264fd38b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317260712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fac40f-299b-4c64-9e04-5f18ce2d94bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93b890e-85bc-4fa8-8b64-1efdb0fa15f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e93b890e-85bc-4fa8-8b64-1efdb0fa15f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8786d281-9850-4883-8583-61e33041d81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8786d281-9850-4883-8583-61e33041d81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88fac40f-299b-4c64-9e04-5f18ce2d94bf', 'volume_name': 'volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76626541-aadd-45fd-855e-8be965aa9f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76626541-aadd-45fd-855e-8be965aa9f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a592f0f-1bf6-438d-9cc7-408fe5d1839b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Volume 88fac40f-299b-4c64-9e04-5f18ce2d94bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf', 'volume_size': 1}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (98660f02-8220-49ed-92c5-ca785b8febba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a69f67d-e2dc-442f-906d-7d81d244452f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a69f67d-e2dc-442f-906d-7d81d244452f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1153413948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b641d2ac-282c-4da2-8a7c-4003f735df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:45Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a3edc4-8b8f-4009-ae32-f659a6cd54e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a3edc4-8b8f-4009-ae32-f659a6cd54e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f881a6-6017-4207-bfa1-1c24266cea7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96f881a6-6017-4207-bfa1-1c24266cea7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b641d2ac-282c-4da2-8a7c-4003f735df93', 'volume_name': 'volume-b641d2ac-282c-4da2-8a7c-4003f735df93', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b9a34c-d981-4085-899a-ba63d6ea6ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98b9a34c-d981-4085-899a-ba63d6ea6ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b9d3de-7739-4b53-a802-d8260929bbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:44 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Volume b641d2ac-282c-4da2-8a7c-4003f735df93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b641d2ac-282c-4da2-8a7c-4003f735df93', 'volume_size': 1}
Jul 06 21:09:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:45 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e 1073741824" returned: 0 in 1.471s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:45 devstack sudo[105679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e
Jul 06 21:09:45 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (a6f94bb4-931f-4c83-9523-530f90929f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a878f1-041c-41a5-b146-ce5fd7ce7c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a878f1-041c-41a5-b146-ce5fd7ce7c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1078540930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4f7b7b-a763-4e41-8039-9cd489e77755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:45Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b1b590-24b7-4eab-8655-7561c4e986a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b1b590-24b7-4eab-8655-7561c4e986a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6b49cf-cb19-406b-bd5d-6857b728dc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e6b49cf-cb19-406b-bd5d-6857b728dc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b4f7b7b-a763-4e41-8039-9cd489e77755', 'volume_name': 'volume-9b4f7b7b-a763-4e41-8039-9cd489e77755', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d9052a-c4a3-4d7c-bcb2-37a4ab0acddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d9052a-c4a3-4d7c-bcb2-37a4ab0acddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fef71e-45d5-4ced-8d73-730b0a63534c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Volume 9b4f7b7b-a763-4e41-8039-9cd489e77755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b4f7b7b-a763-4e41-8039-9cd489e77755', 'volume_size': 1}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:45 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e" returned: 0 in 0.804s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.187s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-247037150',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8370161-4f25-4f15-a1bb-efdd30bc44af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Creating volume a8370161-4f25-4f15-a1bb-efdd30bc44af {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:45 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:45 devstack sudo[105682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af 1073741824
Jul 06 21:09:45 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (176a1020-aa68-4cd1-abcc-7c71942d35e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34537d34-4cac-4cc8-8640-93f0d27d78bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Volume volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e (30cbdbc0-1c1f-419a-a466-e1aed95d715e): created successfully
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34537d34-4cac-4cc8-8640-93f0d27d78bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (649f9158-b1b1-4d10-92ff-2106e72fc887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:46 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1466ae77-42b1-4e34-a500-45acc3636397 tempest-CreateVolumesFromImageTest-2033889293 None] Created volume successfully.
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Flow 'volume_create_manager' (f1cbfa33-e8c5-483d-85bb-6856778d462a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7910dcc8-84e7-46e3-bb96-99a82f59c3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7910dcc8-84e7-46e3-bb96-99a82f59c3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163293b5-9960-4526-a79a-e6a7c70e8a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d645f8a051c94524a23bae1b784fd572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:47Z,use_quota=True,user_id='15ef368fea5248ab8e4c5769fb037a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951eb4c2-53e0-41fa-b985-21bedbe38874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951eb4c2-53e0-41fa-b985-21bedbe38874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2436812-b4fe-4659-9b16-09af4e6ba183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 21:09:46 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af 1073741824" returned: 0 in 1.039s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:47 devstack sudo[105688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af
Jul 06 21:09:47 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2436812-b4fe-4659-9b16-09af4e6ba183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '163293b5-9960-4526-a79a-e6a7c70e8a99', 'volume_name': 'volume-163293b5-9960-4526-a79a-e6a7c70e8a99', 'volume_size': 1, 'image_id': 'dc55c47c-75e6-4657-84cd-972355634fa1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc55c47c-75e6-4657-84cd-972355634fa1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63f5d14d5af2f25899667d27bf99ac04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd645f8a051c94524a23bae1b784fd572', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f6af0b5d866e807f7f17edae431e8b3c38b81a1db2ae2a3fead178e9d02c3e9f8716ad3949f69b696fa59bdfc304a04147da3fde3c2d2d848063948d8c1ac8f', 'id': 'dc55c47c-75e6-4657-84cd-972355634fa1', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc55c47c-75e6-4657-84cd-972355634fa1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec3fe870>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33206810-7f1e-444b-96a1-4f501c9d415b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33206810-7f1e-444b-96a1-4f501c9d415b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5123d74-93a6-4d6d-9e7e-1f897a0bb4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:47 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Volume 163293b5-9960-4526-a79a-e6a7c70e8a99: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-163293b5-9960-4526-a79a-e6a7c70e8a99', 'volume_size': 1, 'image_id': 'dc55c47c-75e6-4657-84cd-972355634fa1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc55c47c-75e6-4657-84cd-972355634fa1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63f5d14d5af2f25899667d27bf99ac04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd645f8a051c94524a23bae1b784fd572', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f6af0b5d866e807f7f17edae431e8b3c38b81a1db2ae2a3fead178e9d02c3e9f8716ad3949f69b696fa59bdfc304a04147da3fde3c2d2d848063948d8c1ac8f', 'id': 'dc55c47c-75e6-4657-84cd-972355634fa1', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc55c47c-75e6-4657-84cd-972355634fa1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec3fe870>}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Trying to clone 163293b5-9960-4526-a79a-e6a7c70e8a99 from image dc55c47c-75e6-4657-84cd-972355634fa1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dc55c47c-75e6-4657-84cd-972355634fa1', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 21:09:47 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c5a398a-778f-4469-8a32-8a2100ad1c2e]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:47 devstack sudo[105690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD
Jul 06 21:09:47 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:47 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af" returned: 0 in 0.750s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.862s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-506827227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160cc636-81a6-45e7-b76b-d2db27363f68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Creating volume 160cc636-81a6-45e7-b76b-d2db27363f68 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:47 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ed823f3-59c4-494d-8d55-c6c87cf05575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8370161-4f25-4f15-a1bb-efdd30bc44af', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:47 devstack sudo[105693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68 1073741824
Jul 06 21:09:47 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e6af66-97ec-4d86-8323-c7b86dd42e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:47 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume volume-a8370161-4f25-4f15-a1bb-efdd30bc44af (a8370161-4f25-4f15-a1bb-efdd30bc44af): created successfully
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e6af66-97ec-4d86-8323-c7b86dd42e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (2f9f76d5-54cb-4018-bc63-e896aa77d7ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e75c5181-db20-498e-8781-af7fdbd6e63d tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created volume successfully.
Jul 06 21:09:48 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:48 devstack sudo[105697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD
Jul 06 21:09:48 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Flow 'volume_create_manager' (f042fe4c-11d4-4645-a395-926734114aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5fa77a-3f3e-4c6b-bf88-1cc4a6e76d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5fa77a-3f3e-4c6b-bf88-1cc4a6e76d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c64bca-b75b-42c8-98bb-2a38f262b412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aad99ae003b473686b0e2ae809c83d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:48Z,use_quota=True,user_id='ad2061bcb7f943fc83a4b64df5fef0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a367954b-22db-415a-be74-5669118c556b),volume_type_id=a367954b-22db-415a-be74-5669118c556b)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7acc145-50b4-44a7-aaef-953977de2567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7acc145-50b4-44a7-aaef-953977de2567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc21ee9-ce4b-4e68-b6f6-2ac85ac2b8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.image.glance [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Creating Keystone auth plugin from conf {{(pid=86721) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cc21ee9-ce4b-4e68-b6f6-2ac85ac2b8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '98c64bca-b75b-42c8-98bb-2a38f262b412', 'volume_name': 'volume-98c64bca-b75b-42c8-98bb-2a38f262b412', 'volume_size': 1, 'image_id': '333af4a8-cfc6-4435-9c23-946c17b43e39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/333af4a8-cfc6-4435-9c23-946c17b43e39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5c220185c1108c471c03657a48e551e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1aad99ae003b473686b0e2ae809c83d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abb938b9a903e2639db218d039df014ff75321b9ff1475729e5e49be62b0493c784ba8a0953e5f5a8160db84d883e0159091f58f03fc48759edfe419569a2d3b', 'id': '333af4a8-cfc6-4435-9c23-946c17b43e39', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/333af4a8-cfc6-4435-9c23-946c17b43e39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec480110>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca46e4a-ced8-4a5c-b731-42adc41d01be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca46e4a-ced8-4a5c-b731-42adc41d01be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea7de0c-e1b3-484e-a145-38cd49e15115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:48 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Volume 98c64bca-b75b-42c8-98bb-2a38f262b412: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-98c64bca-b75b-42c8-98bb-2a38f262b412', 'volume_size': 1, 'image_id': '333af4a8-cfc6-4435-9c23-946c17b43e39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/333af4a8-cfc6-4435-9c23-946c17b43e39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5c220185c1108c471c03657a48e551e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1aad99ae003b473686b0e2ae809c83d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abb938b9a903e2639db218d039df014ff75321b9ff1475729e5e49be62b0493c784ba8a0953e5f5a8160db84d883e0159091f58f03fc48759edfe419569a2d3b', 'id': '333af4a8-cfc6-4435-9c23-946c17b43e39', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/333af4a8-cfc6-4435-9c23-946c17b43e39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec480110>}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Trying to clone 98c64bca-b75b-42c8-98bb-2a38f262b412 from image 333af4a8-cfc6-4435-9c23-946c17b43e39 at location (None, [{'url': 'file:///opt/stack/data/glance/images/333af4a8-cfc6-4435-9c23-946c17b43e39', 'metadata': {}}]). {{(pid=86721) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}}
Jul 06 21:09:48 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Image download 0.00 MB at 0.00 MB/s
Jul 06 21:09:48 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68 1073741824" returned: 0 in 0.965s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[748bff65-b0b9-4ed3-809f-8953f645bf7b]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:48 devstack sudo[105705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68
Jul 06 21:09:48 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:48 devstack sudo[105704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD
Jul 06 21:09:48 devstack sudo[105704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:48 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD" returned: 1 in 0.901s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:09:48 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Temporary image dc55c47c-75e6-4657-84cd-972355634fa1 is fetched for user 15ef368fea5248ab8e4c5769fb037a54. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b706a9f9-33ce-42d7-8d59-6d980e62f048]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:49 devstack sudo[105711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD
Jul 06 21:09:49 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (2603e71a-c478-49aa-b689-397bfaa22542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f34362-efe0-4da9-8b42-fca39ac1e124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f34362-efe0-4da9-8b42-fca39ac1e124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59601994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce109b6-69b9-4690-a9ec-136d607f08ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:49Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7827cefb-4c26-4c0c-8106-98d3ab685765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7827cefb-4c26-4c0c-8106-98d3ab685765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:49 devstack sudo[105704]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f00ced4-c356-44af-93e3-f2616fe3f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f00ced4-c356-44af-93e3-f2616fe3f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce109b6-69b9-4690-a9ec-136d607f08ab', 'volume_name': 'volume-6ce109b6-69b9-4690-a9ec-136d607f08ab', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9efca596-469f-4da8-b456-30ad623a907f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9efca596-469f-4da8-b456-30ad623a907f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38684525-67dc-4b20-8d10-4a34ab7e615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:49 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume 6ce109b6-69b9-4690-a9ec-136d607f08ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce109b6-69b9-4690-a9ec-136d607f08ab', 'volume_size': 1}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD" returned: 0 in 0.906s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:49 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:49 devstack sudo[105715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD
Jul 06 21:09:49 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68" returned: 0 in 1.075s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.128s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.366s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1317260712',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fac40f-299b-4c64-9e04-5f18ce2d94bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:44Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Creating volume 88fac40f-299b-4c64-9e04-5f18ce2d94bf {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:49 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:49 devstack sudo[105718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf 1073741824
Jul 06 21:09:49 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1aadf2-8ecd-49a3-bf6c-4e885f61a53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160cc636-81a6-45e7-b76b-d2db27363f68', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a72aaa3-84bd-42e5-a2e5-4c33aa7f88ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Volume volume-160cc636-81a6-45e7-b76b-d2db27363f68 (160cc636-81a6-45e7-b76b-d2db27363f68): created successfully
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a72aaa3-84bd-42e5-a2e5-4c33aa7f88ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (8bddbaab-a8be-447e-bc01-4599efa8b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (8bf293c0-c7b5-4202-af00-213abe70b6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847334e7-51a0-4129-a70c-7efc69d01fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-738ecd65-e444-4bf2-ba19-586c15cbb74f tempest-CreateVolumesFromImageTest-2033889293 None] Created volume successfully.
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (847334e7-51a0-4129-a70c-7efc69d01fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631698872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc19f2c4-9c53-4fa2-bbee-469ecea20e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:50Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa27ff9f-82e6-4541-9e9a-02c6e0024615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa27ff9f-82e6-4541-9e9a-02c6e0024615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871f5dfb-567d-4586-8d0e-627c4f19b612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (871f5dfb-567d-4586-8d0e-627c4f19b612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc19f2c4-9c53-4fa2-bbee-469ecea20e5a', 'volume_name': 'volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa30e6b5-720b-4c11-bf69-a720713f6673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa30e6b5-720b-4c11-bf69-a720713f6673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b077522-7491-44a3-8a0d-a1d6535ebb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume fc19f2c4-9c53-4fa2-bbee-469ecea20e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a', 'volume_size': 1}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:50 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD" returned: 0 in 1.348s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:50 devstack sudo[105722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD
Jul 06 21:09:50 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (8e0c98cb-86c5-4f8d-a86e-d5b4344ea492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4311fa5c-d72a-43a1-8366-5b783b4786e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4311fa5c-d72a-43a1-8366-5b783b4786e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2074589786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e61f622-56af-4356-b2ae-0e4d909324ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:51Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b026f6-0003-41f1-80e5-93d7f0a4b875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1b026f6-0003-41f1-80e5-93d7f0a4b875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af7c42f-fcc9-41b0-aa7f-3925419e5c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0af7c42f-fcc9-41b0-aa7f-3925419e5c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e61f622-56af-4356-b2ae-0e4d909324ba', 'volume_name': 'volume-5e61f622-56af-4356-b2ae-0e4d909324ba', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c8459f-0826-4a81-9e95-80cfe788dd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c8459f-0826-4a81-9e95-80cfe788dd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736725f5-42ec-47c5-9a93-88c4014f2c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:50 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume 5e61f622-56af-4356-b2ae-0e4d909324ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e61f622-56af-4356-b2ae-0e4d909324ba', 'volume_size': 1}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD" returned: 1 in 1.165s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Temporary image 333af4a8-cfc6-4435-9c23-946c17b43e39 is fetched for user ad2061bcb7f943fc83a4b64df5fef0e2. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6dbc84-78d5-48ea-8651-50c99a0999d0]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:51 devstack sudo[105730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD
Jul 06 21:09:51 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (ac22c385-3ad7-47af-915b-03423d1af40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf41530-c294-43bd-b896-d31c59b307e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf41530-c294-43bd-b896-d31c59b307e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413966603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595474a7-b069-4186-b9b7-e10bf30439a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:51Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b08fd3-2325-474a-a334-009142cba47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51b08fd3-2325-474a-a334-009142cba47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c752d92-e01e-4bbd-9372-1b82ac9b02cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c752d92-e01e-4bbd-9372-1b82ac9b02cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595474a7-b069-4186-b9b7-e10bf30439a7', 'volume_name': 'volume-595474a7-b069-4186-b9b7-e10bf30439a7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4470f6-c32b-40a9-a032-e174f0b77cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab4470f6-c32b-40a9-a032-e174f0b77cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e594fa04-d862-48cd-bb05-9170f3f5e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume 595474a7-b069-4186-b9b7-e10bf30439a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595474a7-b069-4186-b9b7-e10bf30439a7', 'volume_size': 1}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:51 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf 1073741824" returned: 0 in 1.446s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:51 devstack sudo[105735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf
Jul 06 21:09:51 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:51 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD" returned: 1 in 1.013s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (b8b311ef-05e1-460d-a102-65d703eb3fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01070b8-0350-4451-a19e-b82cb8704d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01070b8-0350-4451-a19e-b82cb8704d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192151385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b751d45-9e0b-4ac1-be19-9617efa5a52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:52Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3d9fa2-5241-4a64-9791-f67f5193d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d3d9fa2-5241-4a64-9791-f67f5193d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0d676b-6d17-406f-8f8c-52f13d38f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0d676b-6d17-406f-8f8c-52f13d38f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b751d45-9e0b-4ac1-be19-9617efa5a52b', 'volume_name': 'volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f5baed-c613-4e41-8dd0-f943357a359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f5baed-c613-4e41-8dd0-f943357a359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eaa5905-2d68-4ec7-aa43-e86b4c415b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume 5b751d45-9e0b-4ac1-be19-9617efa5a52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b', 'volume_size': 1}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:51 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD" returned: 0 in 0.958s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:52 devstack sudo[105739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD
Jul 06 21:09:52 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:52 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf" returned: 0 in 0.756s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.268s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.346s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1153413948',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b641d2ac-282c-4da2-8a7c-4003f735df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:45Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Creating volume b641d2ac-282c-4da2-8a7c-4003f735df93 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:52 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a592f0f-1bf6-438d-9cc7-408fe5d1839b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:52 devstack sudo[105742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93 1073741824
Jul 06 21:09:52 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2a489f-32ce-44ab-91da-a1d4a5a46237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:52 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Volume volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf (88fac40f-299b-4c64-9e04-5f18ce2d94bf): created successfully
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe2a489f-32ce-44ab-91da-a1d4a5a46237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (46777ace-c7f9-4188-8502-ca9935c5a240) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-dd2a152e-391e-4217-9e44-3aec5244377e tempest-CreateVolumesFromImageTest-2033889293 None] Created volume successfully.
Jul 06 21:09:52 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD" returned: 1 in 0.746s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:09:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:53 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93 1073741824" returned: 0 in 0.825s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:53 devstack sudo[105751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93
Jul 06 21:09:53 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:53 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93" returned: 0 in 0.660s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.434s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1078540930',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b4f7b7b-a763-4e41-8039-9cd489e77755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ceda696cb584378b1bb498718b563e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:45Z,use_quota=True,user_id='7a2906fb1b034a1fabe1b821503375d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Creating volume 9b4f7b7b-a763-4e41-8039-9cd489e77755 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:53 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:53 devstack sudo[105754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755 1073741824
Jul 06 21:09:53 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b9d3de-7739-4b53-a802-d8260929bbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b641d2ac-282c-4da2-8a7c-4003f735df93', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f79b32-9f69-42aa-a769-e07c31b9dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:53 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Volume volume-b641d2ac-282c-4da2-8a7c-4003f735df93 (b641d2ac-282c-4da2-8a7c-4003f735df93): created successfully
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f79b32-9f69-42aa-a769-e07c31b9dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:53 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (98660f02-8220-49ed-92c5-ca785b8febba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fac9a3e3-0757-4cd4-b6a2-90e7fda21bbb tempest-CreateVolumesFromImageTest-2033889293 None] Created volume successfully.
Jul 06 21:09:54 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755 1073741824" returned: 0 in 0.832s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:54 devstack sudo[105759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755
Jul 06 21:09:54 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:55 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755" returned: 0 in 0.670s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.587s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-59601994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ce109b6-69b9-4690-a9ec-136d607f08ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:49Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Creating volume 6ce109b6-69b9-4690-a9ec-136d607f08ab {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:55 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fef71e-45d5-4ced-8d73-730b0a63534c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b4f7b7b-a763-4e41-8039-9cd489e77755', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d109edb9-bb56-4d19-9d3d-1acb32cac434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:55 devstack sudo[105762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab 1073741824
Jul 06 21:09:55 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Volume volume-9b4f7b7b-a763-4e41-8039-9cd489e77755 (9b4f7b7b-a763-4e41-8039-9cd489e77755): created successfully
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d109edb9-bb56-4d19-9d3d-1acb32cac434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Flow 'volume_create_manager' (a6f94bb4-931f-4c83-9523-530f90929f3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:55 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-09661066-b3d8-4787-8984-15fdf7ed0a24 tempest-CreateVolumesFromImageTest-2033889293 None] Created volume successfully.
Jul 06 21:09:56 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab 1073741824" returned: 0 in 0.849s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-9b4f7b7b-a763-4e41-8039-9cd489e77755-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-9b4f7b7b-a763-4e41-8039-9cd489e77755-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:56 devstack sudo[105767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab
Jul 06 21:09:56 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-quobyte-9b4f7b7b-a763-4e41-8039-9cd489e77755" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-9b4f7b7b-a763-4e41-8039-9cd489e77755" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53b2615-d252-4531-b3f9-ae69541a7775]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:56 devstack sudo[105769]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755
Jul 06 21:09:56 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:56 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab" returned: 0 in 0.696s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] <== create_volume: return (1594ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.684s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1631698872',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc19f2c4-9c53-4fa2-bbee-469ecea20e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:50Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Creating volume fc19f2c4-9c53-4fa2-bbee-469ecea20e5a {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:56 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:56 devstack sudo[105772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a 1073741824
Jul 06 21:09:56 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38684525-67dc-4b20-8d10-4a34ab7e615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce109b6-69b9-4690-a9ec-136d607f08ab', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25101d34-3c24-4cfa-bfd9-9fd06a23f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:56 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume volume-6ce109b6-69b9-4690-a9ec-136d607f08ab (6ce109b6-69b9-4690-a9ec-136d607f08ab): created successfully
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25101d34-3c24-4cfa-bfd9-9fd06a23f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (2603e71a-c478-49aa-b689-397bfaa22542) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-358a7a1b-027c-44e7-9786-619e5e013317 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created volume successfully.
Jul 06 21:09:57 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755" returned: 0 in 0.838s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:57 devstack sudo[105777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755
Jul 06 21:09:57 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:57 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a 1073741824" returned: 0 in 0.866s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:57 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9b4f7b7b-a763-4e41-8039-9cd489e77755" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:57 devstack sudo[105783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a
Jul 06 21:09:57 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-9b4f7b7b-a763-4e41-8039-9cd489e77755" released by "delete_volume" :: held 1.604s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Created reservations ['d94831b4-1c77-4057-bb3d-c02d0369608e', '6ee9e35f-1dab-4c51-a07e-9556035401a8', 'dfc7b23b-6a82-446d-b76f-f30a0547e9c9', '74917da8-b2d3-43b7-8f8c-8d8bec152a12'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:58 devstack sudo[105785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:09:58 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-b641d2ac-282c-4da2-8a7c-4003f735df93-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-b641d2ac-282c-4da2-8a7c-4003f735df93-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-quobyte-b641d2ac-282c-4da2-8a7c-4003f735df93" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-b641d2ac-282c-4da2-8a7c-4003f735df93" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb335a52-8f4e-4eb3-9662-c551e872a297]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:58 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a" returned: 0 in 0.772s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.741s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2074589786',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e61f622-56af-4356-b2ae-0e4d909324ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:51Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Creating volume 5e61f622-56af-4356-b2ae-0e4d909324ba {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:09:58 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b077522-7491-44a3-8a0d-a1d6535ebb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:58 devstack sudo[105791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba 1073741824
Jul 06 21:09:58 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a603212f-4ced-469b-b749-b42ea492073f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:09:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a (fc19f2c4-9c53-4fa2-bbee-469ecea20e5a): created successfully
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a603212f-4ced-469b-b749-b42ea492073f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (8bf293c0-c7b5-4202-af00-213abe70b6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:09:58 devstack sudo[105789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93
Jul 06 21:09:58 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7c0dcbaa-3859-4334-98a9-007cafc74064 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created volume successfully.
Jul 06 21:09:58 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.702s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:09:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Deleted volume successfully.
Jul 06 21:09:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7857479-86d3-477f-b867-68111078e02d tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-9b4f7b7b-a763-4e41-8039-9cd489e77755-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:09:59 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93" returned: 0 in 0.818s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:59 devstack sudo[105800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93
Jul 06 21:09:59 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:09:59 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root
Jul 06 21:09:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba 1073741824" returned: 0 in 0.881s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:09:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:09:59 devstack sudo[105802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba
Jul 06 21:09:59 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:00 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b641d2ac-282c-4da2-8a7c-4003f735df93" returned: 0 in 0.680s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-b641d2ac-282c-4da2-8a7c-4003f735df93" released by "delete_volume" :: held 1.547s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Created reservations ['b7504cc1-00e7-4e5d-8f7e-ac8cde88bbcf', '8cdbecba-1bcc-45c5-ad69-9a890d9ac868', '1742d93b-51e6-4fe2-91f1-9cdc35a53760', '6a1481df-280d-4dad-8953-c725257bde00'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:00 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba" returned: 0 in 0.680s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.890s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1413966603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595474a7-b069-4186-b9b7-e10bf30439a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:51Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Creating volume 595474a7-b069-4186-b9b7-e10bf30439a7 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:00 devstack sudo[105806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:00 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:00 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (736725f5-42ec-47c5-9a93-88c4014f2c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e61f622-56af-4356-b2ae-0e4d909324ba', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:00 devstack sudo[105808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7 1073741824
Jul 06 21:10:00 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8864f9-b037-412d-a111-9c6400c73d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume volume-5e61f622-56af-4356-b2ae-0e4d909324ba (5e61f622-56af-4356-b2ae-0e4d909324ba): created successfully
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e8864f9-b037-412d-a111-9c6400c73d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (8e0c98cb-86c5-4f8d-a86e-d5b4344ea492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-91528dbf-f580-4da4-b430-e8e662b978c0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created volume successfully.
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-88fac40f-299b-4c64-9e04-5f18ce2d94bf-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-88fac40f-299b-4c64-9e04-5f18ce2d94bf-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-quobyte-88fac40f-299b-4c64-9e04-5f18ce2d94bf" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-88fac40f-299b-4c64-9e04-5f18ce2d94bf" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb2776-6375-44ce-b333-93c11acc7f1e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:00 devstack sudo[105810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf
Jul 06 21:10:00 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:00 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.738s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Deleted volume successfully.
Jul 06 21:10:00 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-808916c3-457e-4685-aeb3-0b2d7401177e tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-b641d2ac-282c-4da2-8a7c-4003f735df93-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:01 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7 1073741824" returned: 0 in 0.930s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:01 devstack sudo[105817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7
Jul 06 21:10:01 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:01 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf" returned: 0 in 0.833s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:01 devstack sudo[105822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf
Jul 06 21:10:01 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:01 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7" returned: 0 in 0.637s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.371s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=163293b5-9960-4526-a79a-e6a7c70e8a99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d645f8a051c94524a23bae1b784fd572',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:47Z,use_quota=True,user_id='15ef368fea5248ab8e4c5769fb037a54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Creating volume 163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:01 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:01 devstack sudo[105825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 1073741824
Jul 06 21:10:01 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e594fa04-d862-48cd-bb05-9170f3f5e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595474a7-b069-4186-b9b7-e10bf30439a7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d5a490-dfba-4f3c-aea3-836fa441167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:01 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume volume-595474a7-b069-4186-b9b7-e10bf30439a7 (595474a7-b069-4186-b9b7-e10bf30439a7): created successfully
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19d5a490-dfba-4f3c-aea3-836fa441167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:01 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (ac22c385-3ad7-47af-915b-03423d1af40f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:01 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8effb9b5-8414-4a67-9a78-7b622726b37e tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created volume successfully.
Jul 06 21:10:02 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-88fac40f-299b-4c64-9e04-5f18ce2d94bf" returned: 0 in 0.741s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-88fac40f-299b-4c64-9e04-5f18ce2d94bf" released by "delete_volume" :: held 1.642s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Created reservations ['228a9f80-8e1a-4f7e-82aa-48b1a8b90167', '3c0674e9-b4b2-464a-978f-0220d174b3ad', '722ab5fa-fe60-4c2d-918c-f01b731a96e3', '58925152-6688-45da-b1cf-df186b6ef4e4'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:02 devstack sudo[105831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:02 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:02 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 1073741824" returned: 0 in 0.882s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:02 devstack sudo[105833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99
Jul 06 21:10:02 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-160cc636-81a6-45e7-b76b-d2db27363f68-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-160cc636-81a6-45e7-b76b-d2db27363f68-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-quobyte-160cc636-81a6-45e7-b76b-d2db27363f68" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-160cc636-81a6-45e7-b76b-d2db27363f68" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ae81f9-9cfc-41b2-b9bc-b63e2bb41c8f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:03 devstack sudo[105835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68
Jul 06 21:10:03 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:03 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.772s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Deleted volume successfully.
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-63900430-b87b-4a7d-92b2-de48ba333848 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-88fac40f-299b-4c64-9e04-5f18ce2d94bf-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:03 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99" returned: 0 in 0.663s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.584s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1192151385',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b751d45-9e0b-4ac1-be19-9617efa5a52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee86f14a9e1841a58f4d99304ffbb627',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:52Z,use_quota=True,user_id='7bd6dd19afda470e9d916f83872a22d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Creating volume 5b751d45-9e0b-4ac1-be19-9617efa5a52b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:03 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:03 devstack sudo[105839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b 1073741824
Jul 06 21:10:03 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Attempting download of dc55c47c-75e6-4657-84cd-972355634fa1 ((None, [{'url': 'file:///opt/stack/data/glance/images/dc55c47c-75e6-4657-84cd-972355634fa1', 'metadata': {}}])) to volume 163293b5-9960-4526-a79a-e6a7c70e8a99. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[697f0002-2dac-4593-b964-3e4cff292d5c]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc55c47c-75e6-4657-84cd-972355634fa1_98ydbti0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:03 devstack sudo[105841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc55c47c-75e6-4657-84cd-972355634fa1_98ydbti0
Jul 06 21:10:03 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:03 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68" returned: 0 in 0.833s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:03 devstack sudo[105846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68
Jul 06 21:10:03 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:04 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b 1073741824" returned: 0 in 0.871s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:04 devstack sudo[105853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b
Jul 06 21:10:04 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:04 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dc55c47c-75e6-4657-84cd-972355634fa1_98ydbti0" returned: 0 in 0.923s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc55c47c-75e6-4657-84cd-972355634fa1_98ydbti0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:04 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-160cc636-81a6-45e7-b76b-d2db27363f68" returned: 0 in 0.704s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-160cc636-81a6-45e7-b76b-d2db27363f68" released by "delete_volume" :: held 1.585s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:04 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc55c47c-75e6-4657-84cd-972355634fa1_98ydbti0
Jul 06 21:10:04 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Created reservations ['b35e4b81-8879-471f-a579-150178a30f05', '34b3676e-6a28-45ee-83af-d3ba64fab40f', '39f92aa2-31bf-45cb-b4da-87ee4af4d89b', 'db66408b-cb36-4bc5-8e12-5cf3566d279a'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:04 devstack sudo[105859]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:04 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:05 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b" returned: 0 in 0.684s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.391s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c64bca-b75b-42c8-98bb-2a38f262b412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aad99ae003b473686b0e2ae809c83d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:48Z,use_quota=True,user_id='ad2061bcb7f943fc83a4b64df5fef0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a367954b-22db-415a-be74-5669118c556b),volume_type_id=a367954b-22db-415a-be74-5669118c556b)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Creating volume 98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:05 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:05 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 1073741824
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eaa5905-2d68-4ec7-aa43-e86b4c415b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:05 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d1755e-c84a-4f6c-b84a-8804b766a171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:05 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Volume volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b (5b751d45-9e0b-4ac1-be19-9617efa5a52b): created successfully
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d1755e-c84a-4f6c-b84a-8804b766a171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Flow 'volume_create_manager' (b8b311ef-05e1-460d-a102-65d703eb3fb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5747148e-3f23-4d4c-bb33-333745bd33dd tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created volume successfully.
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-30cbdbc0-1c1f-419a-a466-e1aed95d715e-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-30cbdbc0-1c1f-419a-a466-e1aed95d715e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "cinder-quobyte-30cbdbc0-1c1f-419a-a466-e1aed95d715e" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-30cbdbc0-1c1f-419a-a466-e1aed95d715e" acquired by "delete_volume" :: waited 0.039s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:05 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc55c47c-75e6-4657-84cd-972355634fa1_98ydbti0" returned: 1 in 0.852s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dc55c47c-75e6-4657-84cd-972355634fa1_98ydbti0' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dd19cc-ee47-4aca-b26e-b3c711142e4a]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c812cf65-c75e-4fed-807e-e7240c9614c2]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:05 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD
Jul 06 21:10:05 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:05 devstack sudo[105868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e
Jul 06 21:10:05 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:05 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.798s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Deleted volume successfully.
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-09e45eb5-2c4f-4fda-8571-f040cf6f0f91 tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-160cc636-81a6-45e7-b76b-d2db27363f68-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-5b751d45-9e0b-4ac1-be19-9617efa5a52b-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-5b751d45-9e0b-4ac1-be19-9617efa5a52b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-quobyte-5b751d45-9e0b-4ac1-be19-9617efa5a52b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-5b751d45-9e0b-4ac1-be19-9617efa5a52b" acquired by "delete_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[48231ef3-2485-4002-bea0-8484e2a083c8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:06 devstack sudo[105877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b
Jul 06 21:10:06 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:06 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 1073741824" returned: 0 in 1.132s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:06 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD" returned: 0 in 0.876s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:06 devstack sudo[105886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412
Jul 06 21:10:06 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:06 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e" returned: 0 in 1.005s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:06 devstack sudo[105885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD
Jul 06 21:10:06 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:06 devstack sudo[105888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e
Jul 06 21:10:06 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:06 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b" returned: 0 in 0.939s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:06 devstack sudo[105895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b
Jul 06 21:10:06 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:06 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412" returned: 0 in 0.701s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:06 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Attempting download of 333af4a8-cfc6-4435-9c23-946c17b43e39 ((None, [{'url': 'file:///opt/stack/data/glance/images/333af4a8-cfc6-4435-9c23-946c17b43e39', 'metadata': {}}])) to volume 98c64bca-b75b-42c8-98bb-2a38f262b412. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ddd8e9-1279-4f51-9a81-4cc632dafffc]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_333af4a8-cfc6-4435-9c23-946c17b43e39_jwr514q_ {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:07 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-30cbdbc0-1c1f-419a-a466-e1aed95d715e" returned: 0 in 0.770s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:07 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD" returned: 1 in 0.926s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] dc55c47c-75e6-4657-84cd-972355634fa1 was raw, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-quobyte-30cbdbc0-1c1f-419a-a466-e1aed95d715e" released by "delete_volume" :: held 1.884s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:07 devstack sudo[105901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_333af4a8-cfc6-4435-9c23-946c17b43e39_jwr514q_
Jul 06 21:10:07 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:07 devstack sudo[105902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99
Jul 06 21:10:07 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Created reservations ['a3ae22de-82dd-4fc5-af78-74cfa1b1cdff', '653e9aa8-2315-4a81-a7d7-c1cc67e004f5', '1bfca56d-9312-4a9b-934a-acbf3eba8e63', '1eb40916-c3e5-4e6f-a155-c8c3ed6964f4'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:07 devstack sudo[105905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:07 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:07 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5b751d45-9e0b-4ac1-be19-9617efa5a52b" returned: 0 in 0.887s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-5b751d45-9e0b-4ac1-be19-9617efa5a52b" released by "delete_volume" :: held 1.883s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:07 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_333af4a8-cfc6-4435-9c23-946c17b43e39_jwr514q_" returned: 0 in 0.792s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_333af4a8-cfc6-4435-9c23-946c17b43e39_jwr514q_ {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created reservations ['d83c8b79-63da-4a6e-81df-5ba9ef9ef35c', 'a23ab392-518a-480c-ab4d-19d627192279', '72a59aca-0c31-42eb-8d76-99ae8bec25f2', '5a35595e-42ab-43fe-a6ca-9ceff465f271'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:08 devstack sudo[105913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_333af4a8-cfc6-4435-9c23-946c17b43e39_jwr514q_
Jul 06 21:10:08 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:08 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:08 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-595474a7-b069-4186-b9b7-e10bf30439a7-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-595474a7-b069-4186-b9b7-e10bf30439a7-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:08 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99" returned: 0 in 1.068s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dc55c47c-75e6-4657-84cd-972355634fa1_ad4s6ouvdevstack@QuobyteHD, size 0.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:10:08 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:08 devstack sudo[105919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 1G
Jul 06 21:10:08 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-quobyte-595474a7-b069-4186-b9b7-e10bf30439a7" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-595474a7-b069-4186-b9b7-e10bf30439a7" acquired by "delete_volume" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:08 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.055s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Deleted volume successfully.
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67daaf5-fe3b-40b3-bf32-7ea631dd8a51]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1ee9986f-2c86-4d9a-9090-08471c57d3ce tempest-CreateVolumesFromImageTest-2033889293 None] Lock "cinder-30cbdbc0-1c1f-419a-a466-e1aed95d715e-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:08 devstack sudo[105921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7
Jul 06 21:10:08 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:09 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_333af4a8-cfc6-4435-9c23-946c17b43e39_jwr514q_" returned: 1 in 1.258s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_333af4a8-cfc6-4435-9c23-946c17b43e39_jwr514q_' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac5335b-7612-4b0c-b41a-0413bb49f573]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:09 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.159s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Deleted volume successfully.
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2aa4002d-de50-4fd4-8e91-ca2286b8d565 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-5b751d45-9e0b-4ac1-be19-9617efa5a52b-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:09 devstack sudo[105929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD
Jul 06 21:10:09 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:09 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 1G" returned: 0 in 1.150s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc36a2-eae5-4aee-b5ba-262c7842feac]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:09 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7" returned: 0 in 1.105s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:09 devstack sudo[105936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7
Jul 06 21:10:09 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:09 devstack sudo[105935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99
Jul 06 21:10:09 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:10 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD" returned: 0 in 0.927s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:10 devstack sudo[105941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD
Jul 06 21:10:10 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:10 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-595474a7-b069-4186-b9b7-e10bf30439a7" returned: 0 in 0.799s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-595474a7-b069-4186-b9b7-e10bf30439a7" released by "delete_volume" :: held 2.004s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created reservations ['7b697654-34c7-4c17-be34-68a66f53cc34', 'a9c04a6e-ccd2-4528-9965-3f200ee2623d', '84ee062d-213f-410a-aa63-f0533b83cbc1', '2d0da5ae-d5ef-4b5f-8ff3-65c40c383281'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:10 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99" returned: 0 in 1.018s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:10 devstack sudo[105946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99
Jul 06 21:10:10 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:10 devstack sudo[105947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:10 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:10 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD" returned: 1 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] 333af4a8-cfc6-4435-9c23-946c17b43e39 was raw, converting to raw {{(pid=86721) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}}
Jul 06 21:10:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:10 devstack sudo[105953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412
Jul 06 21:10:10 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:11 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99" returned: 1 in 0.873s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Downloaded image dc55c47c-75e6-4657-84cd-972355634fa1 ((None, [{'url': 'file:///opt/stack/data/glance/images/dc55c47c-75e6-4657-84cd-972355634fa1', 'metadata': {}}])) to volume 163293b5-9960-4526-a79a-e6a7c70e8a99 successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Temporary image dc55c47c-75e6-4657-84cd-972355634fa1 for user 15ef368fea5248ab8e4c5769fb037a54 is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Marking volume 163293b5-9960-4526-a79a-e6a7c70e8a99 as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Copying metadata from image dc55c47c-75e6-4657-84cd-972355634fa1 to 163293b5-9960-4526-a79a-e6a7c70e8a99. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Creating volume glance metadata for volume 163293b5-9960-4526-a79a-e6a7c70e8a99 backed by image dc55c47c-75e6-4657-84cd-972355634fa1 with: {'image_id': 'dc55c47c-75e6-4657-84cd-972355634fa1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '63f5d14d5af2f25899667d27bf99ac04', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 21:10:11 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.876s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5123d74-93a6-4d6d-9e7e-1f897a0bb4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-163293b5-9960-4526-a79a-e6a7c70e8a99', 'volume_size': 1, 'image_id': 'dc55c47c-75e6-4657-84cd-972355634fa1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dc55c47c-75e6-4657-84cd-972355634fa1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '63f5d14d5af2f25899667d27bf99ac04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd645f8a051c94524a23bae1b784fd572', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3f6af0b5d866e807f7f17edae431e8b3c38b81a1db2ae2a3fead178e9d02c3e9f8716ad3949f69b696fa59bdfc304a04147da3fde3c2d2d848063948d8c1ac8f', 'id': 'dc55c47c-75e6-4657-84cd-972355634fa1', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dc55c47c-75e6-4657-84cd-972355634fa1/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec3fe870>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d553f50-8da1-40be-a30f-af5f4fb99d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Deleted volume successfully.
Jul 06 21:10:11 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Volume volume-163293b5-9960-4526-a79a-e6a7c70e8a99 (163293b5-9960-4526-a79a-e6a7c70e8a99): created successfully
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d553f50-8da1-40be-a30f-af5f4fb99d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Flow 'volume_create_manager' (f1cbfa33-e8c5-483d-85bb-6856778d462a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d7209b88-27cd-44c6-aa6d-4e4d2d2e040c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-595474a7-b069-4186-b9b7-e10bf30439a7-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d22d3273-dc3f-462f-ae88-e8923f9ce412 tempest-VolumeImageDependencyTests-599564754 None] Created volume successfully.
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-5e61f622-56af-4356-b2ae-0e4d909324ba-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-5e61f622-56af-4356-b2ae-0e4d909324ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-quobyte-5e61f622-56af-4356-b2ae-0e4d909324ba" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-5e61f622-56af-4356-b2ae-0e4d909324ba" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f35fc9-56a4-43a1-807e-e3c45b3b9f6f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:11 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412" returned: 0 in 0.919s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_333af4a8-cfc6-4435-9c23-946c17b43e39_iuxto7qgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:10:11 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Converted 0.00 MB image at 0.00 MB/s
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:11 devstack sudo[105962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba
Jul 06 21:10:11 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:11 devstack sudo[105963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 1G
Jul 06 21:10:11 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (92c78414-8619-4072-a1f4-211f940f16de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2149c56e-1c2d-4a44-8757-763b1f4c64f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2149c56e-1c2d-4a44-8757-763b1f4c64f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1262345071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf0290f-8b24-45d5-b288-2d1c05f67cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:12Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab5def-42b2-434e-afd0-db6694b750f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72ab5def-42b2-434e-afd0-db6694b750f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26657aa-3936-48d7-bf2e-4acc8dd3f081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e26657aa-3936-48d7-bf2e-4acc8dd3f081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abf0290f-8b24-45d5-b288-2d1c05f67cdb', 'volume_name': 'volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e8d9ce-71d2-4cb5-a56a-585b5319b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e8d9ce-71d2-4cb5-a56a-585b5319b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f95f2c-b679-4cac-bae5-eb61a250e7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:12 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume abf0290f-8b24-45d5-b288-2d1c05f67cdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb', 'volume_size': 1}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1262345071',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf0290f-8b24-45d5-b288-2d1c05f67cdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:12Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Creating volume abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:12 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:12 devstack sudo[105966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb 1073741824
Jul 06 21:10:12 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:12 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba" returned: 0 in 0.788s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:12 devstack sudo[105974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba
Jul 06 21:10:12 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:12 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 1G" returned: 0 in 0.791s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[248e0199-925b-4e74-879e-173a3cf83983]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Acquiring lock "cinder-163293b5-9960-4526-a79a-e6a7c70e8a99-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Lock "cinder-163293b5-9960-4526-a79a-e6a7c70e8a99-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:12 devstack sudo[105979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412
Jul 06 21:10:12 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Acquiring lock "cinder-quobyte-163293b5-9960-4526-a79a-e6a7c70e8a99" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Lock "cinder-quobyte-163293b5-9960-4526-a79a-e6a7c70e8a99" acquired by "delete_volume" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a58a17d-79f8-4870-95bf-7a704dd52b0d]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:13 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb 1073741824" returned: 0 in 0.975s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:13 devstack sudo[105983]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb
Jul 06 21:10:13 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:13 devstack sudo[105982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99
Jul 06 21:10:13 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:13 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-5e61f622-56af-4356-b2ae-0e4d909324ba" returned: 0 in 0.907s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-5e61f622-56af-4356-b2ae-0e4d909324ba" released by "delete_volume" :: held 1.746s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created reservations ['8f4c129c-6758-4a9c-9759-415c019e0fc3', '9ea86fdd-ccb3-4c92-96b9-9ce067625a28', '539aa903-5f79-478c-9d37-ca919cf6dfaa', '20dbb45c-a673-4b01-9256-f586993c0302'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:13 devstack sudo[105989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:13 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:13 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412" returned: 0 in 1.001s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:13 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99" returned: 0 in 0.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:13 devstack sudo[105993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412
Jul 06 21:10:13 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:13 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2f95f2c-b679-4cac-bae5-eb61a250e7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643d0b4c-cb70-40c3-9338-afe3c12ba564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:13 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb (abf0290f-8b24-45d5-b288-2d1c05f67cdb): created successfully
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (643d0b4c-cb70-40c3-9338-afe3c12ba564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (92c78414-8619-4072-a1f4-211f940f16de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7e9c994a-318e-4675-9829-78525cfdebb6 tempest-CreateVolumesFromSnapshotTest-454551454 None] Created volume successfully.
Jul 06 21:10:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:13 devstack sudo[105996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99
Jul 06 21:10:13 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-quobyte-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a" acquired by "delete_volume" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8442b6-8080-4ed0-9348-c2512733f3bc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:14 devstack sudo[105998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a
Jul 06 21:10:14 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:14 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.903s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:14 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Deleted volume successfully.
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a12c6517-9744-4223-92b1-f1efcab7a3b0 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-5e61f622-56af-4356-b2ae-0e4d909324ba-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Creating offline snapshot 18853d8c-104e-46f9-b581-f5ca9e6f4676 of volume abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[285b0eb6-573b-40b0-b611-b4b4ade87aa8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:14 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412" returned: 1 in 1.255s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Downloaded image 333af4a8-cfc6-4435-9c23-946c17b43e39 ((None, [{'url': 'file:///opt/stack/data/glance/images/333af4a8-cfc6-4435-9c23-946c17b43e39', 'metadata': {}}])) to volume 98c64bca-b75b-42c8-98bb-2a38f262b412 successfully. {{(pid=86721) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Temporary image 333af4a8-cfc6-4435-9c23-946c17b43e39 for user ad2061bcb7f943fc83a4b64df5fef0e2 is deleted. {{(pid=86721) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.volume.volume_utils [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Marking volume 98c64bca-b75b-42c8-98bb-2a38f262b412 as bootable. {{(pid=86721) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Copying metadata from image 333af4a8-cfc6-4435-9c23-946c17b43e39 to 98c64bca-b75b-42c8-98bb-2a38f262b412. {{(pid=86721) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Jul 06 21:10:14 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Creating volume glance metadata for volume 98c64bca-b75b-42c8-98bb-2a38f262b412 backed by image 333af4a8-cfc6-4435-9c23-946c17b43e39 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '333af4a8-cfc6-4435-9c23-946c17b43e39', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd5c220185c1108c471c03657a48e551e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86721) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Jul 06 21:10:14 devstack sudo[106040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb
Jul 06 21:10:14 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ea7de0c-e1b3-484e-a145-38cd49e15115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c64bca-b75b-42c8-98bb-2a38f262b412', 'volume_size': 1, 'image_id': '333af4a8-cfc6-4435-9c23-946c17b43e39', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/333af4a8-cfc6-4435-9c23-946c17b43e39', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd5c220185c1108c471c03657a48e551e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1aad99ae003b473686b0e2ae809c83d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'abb938b9a903e2639db218d039df014ff75321b9ff1475729e5e49be62b0493c784ba8a0953e5f5a8160db84d883e0159091f58f03fc48759edfe419569a2d3b', 'id': '333af4a8-cfc6-4435-9c23-946c17b43e39', 'created_at': datetime.datetime(2026, 7, 6, 19, 9, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 9, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/333af4a8-cfc6-4435-9c23-946c17b43e39/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x713dec480110>}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3b35eb-cba4-4d61-8dda-425578acf9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:15 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Volume volume-98c64bca-b75b-42c8-98bb-2a38f262b412 (98c64bca-b75b-42c8-98bb-2a38f262b412): created successfully
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3b35eb-cba4-4d61-8dda-425578acf9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Flow 'volume_create_manager' (f042fe4c-11d4-4645-a395-926734114aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:15 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8d99fdf4-78bf-47e3-859a-44f81fd80727 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Created volume successfully.
Jul 06 21:10:15 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99" returned: 1 in 1.416s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:15 devstack sudo[106048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99
Jul 06 21:10:15 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:15 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a" returned: 0 in 1.081s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:15 devstack sudo[106050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a
Jul 06 21:10:15 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Acquiring lock "cinder-98c64bca-b75b-42c8-98bb-2a38f262b412-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "cinder-98c64bca-b75b-42c8-98bb-2a38f262b412-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Acquiring lock "cinder-quobyte-98c64bca-b75b-42c8-98bb-2a38f262b412" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "cinder-quobyte-98c64bca-b75b-42c8-98bb-2a38f262b412" acquired by "delete_volume" :: waited 0.032s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953a270-6949-4f77-8249-a955f6fffce7]: (4, 'raw') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:15 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:15 devstack sudo[106055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb" returned: 0 in 0.922s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:15 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:15 devstack sudo[106057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 1G
Jul 06 21:10:15 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:16 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-163293b5-9960-4526-a79a-e6a7c70e8a99" returned: 0 in 0.853s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Lock "cinder-quobyte-163293b5-9960-4526-a79a-e6a7c70e8a99" released by "delete_volume" :: held 3.166s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Created reservations ['14c5c6fa-2d2f-4880-b92b-b2633c531e4d', 'fd50623b-4f01-4ea3-946c-92e46f550584', 'c1cf5d38-f7d1-49dd-9ad4-b0aefb8b9923', '55f7e899-f1f8-4482-8d78-c27d929034e7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:16 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a" returned: 0 in 0.910s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a" released by "delete_volume" :: held 2.076s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:16 devstack sudo[106063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:16 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created reservations ['7fd5c186-0323-4969-a8fe-db870150b9f6', 'f23a2514-68bc-4518-a99d-89b4c15d8d44', '015b558d-f0b2-462b-8793-1ebc969cd456', 'e0f80735-7f96-42c9-b76e-3c0633c15abf'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:16 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:16 devstack sudo[106069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:16 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:16 devstack sudo[106068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412
Jul 06 21:10:16 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:16 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 1G" returned: 0 in 1.025s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:16 devstack sudo[106072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676
Jul 06 21:10:16 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:17 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.780s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:17 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Deleted volume successfully.
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-93eddd19-7500-4000-87f0-9539e120905c tempest-VolumeImageDependencyTests-599564754 None] Lock "cinder-163293b5-9960-4526-a79a-e6a7c70e8a99-delete_volume" released by "delete_volume" :: held 4.339s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:17 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.676s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:17 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Deleted volume successfully.
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-25adb82b-134a-4edd-a59a-2496cfee50ac tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-fc19f2c4-9c53-4fa2-bbee-469ecea20e5a-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:17 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412" returned: 1 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412' failed. Not Retrying. {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:17 devstack sudo[106079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412
Jul 06 21:10:17 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-6ce109b6-69b9-4690-a9ec-136d607f08ab-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-6ce109b6-69b9-4690-a9ec-136d607f08ab-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-quobyte-6ce109b6-69b9-4690-a9ec-136d607f08ab" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:17 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-6ce109b6-69b9-4690-a9ec-136d607f08ab" acquired by "delete_volume" :: waited 0.037s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676" returned: 0 in 0.878s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:17 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 is being set with open permissions: ugo+rw
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf73ccd-00e4-4236-817a-f63bdb12e791]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:17 devstack sudo[106084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676
Jul 06 21:10:17 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:17 devstack sudo[106086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab
Jul 06 21:10:17 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:18 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-98c64bca-b75b-42c8-98bb-2a38f262b412" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "cinder-quobyte-98c64bca-b75b-42c8-98bb-2a38f262b412" released by "delete_volume" :: held 2.576s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Created reservations ['8a25ded5-9787-447f-b0b6-e46ad13a81f2', '105ac213-75f0-4fba-98bf-feb5e6e87def', '22ec7e4a-1ce4-442f-9c4f-b2dd862e184f', 'fc1b1bc6-f153-4aff-bc95-9ea3e7f1d610'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:18 devstack sudo[106090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:18 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:18 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676" returned: 0 in 0.873s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:18 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab" returned: 0 in 0.952s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:18 devstack sudo[106098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab
Jul 06 21:10:18 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:18 devstack sudo[106097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.info
Jul 06 21:10:18 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:19 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.950s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:19 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Deleted volume successfully.
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-02ea8ade-f46f-4d1d-ae08-dcbc2874bde5 tempest-VolumeAndVolumeTypeFromImageTest-694142342 None] Lock "cinder-98c64bca-b75b-42c8-98bb-2a38f262b412-delete_volume" released by "delete_volume" :: held 3.867s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:19 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6ce109b6-69b9-4690-a9ec-136d607f08ab" returned: 0 in 0.969s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-6ce109b6-69b9-4690-a9ec-136d607f08ab" released by "delete_volume" :: held 2.001s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created reservations ['0939c03d-64dc-4469-abd0-e2b4c553bda6', '80a66c43-56d1-476e-9c14-5df2f3f87310', 'd16e8a40-624f-4e7e-aae4-52af8b562e41', '78d3c367-92c9-43e2-a778-70faab9f9587'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:19 devstack sudo[106105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:19 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:19 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.info" returned: 0 in 1.226s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:19 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.info is being set with open permissions: ugo+rw
Jul 06 21:10:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:19 devstack sudo[106107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.info
Jul 06 21:10:19 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:20 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.755s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Deleted volume successfully.
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-680284bd-2a26-4c16-89ab-b42b712ed790 tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-6ce109b6-69b9-4690-a9ec-136d607f08ab-delete_volume" released by "delete_volume" :: held 3.073s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:20 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.info" returned: 0 in 0.881s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.998s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cc9845f6-c080-46fb-ac21-4d24242686d9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Create snapshot completed successfully
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-a8370161-4f25-4f15-a1bb-efdd30bc44af-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-a8370161-4f25-4f15-a1bb-efdd30bc44af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "cinder-quobyte-a8370161-4f25-4f15-a1bb-efdd30bc44af" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-a8370161-4f25-4f15-a1bb-efdd30bc44af" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0145e98-e31c-493f-8e4b-31b2ea671110]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:21 devstack sudo[106111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af
Jul 06 21:10:21 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Flow 'volume_create_manager' (2921067c-4e6e-4b22-b27e-4dc4e1f81a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890e97b1-dd90-433f-9d01-4cc73557f392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (890e97b1-dd90-433f-9d01-4cc73557f392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022fc2bb-d497-48f0-91b3-3809fbe74e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6762cc5f1f3c4846aa0b0889d6d7b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:22Z,use_quota=True,user_id='d54aa6612ce94bebad4da2925de6702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4571a996-ebf5-4775-92e7-51db4ba084f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4571a996-ebf5-4775-92e7-51db4ba084f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6f7aec-1eca-494f-b780-c074400d3ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6f7aec-1eca-494f-b780-c074400d3ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '022fc2bb-d497-48f0-91b3-3809fbe74e95', 'volume_name': 'volume-022fc2bb-d497-48f0-91b3-3809fbe74e95', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b1e00e-dbcf-48d6-b3a1-3b0af090cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b1e00e-dbcf-48d6-b3a1-3b0af090cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b017ef56-ea40-4b8b-89cd-769996f0a39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:21 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Volume 022fc2bb-d497-48f0-91b3-3809fbe74e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-022fc2bb-d497-48f0-91b3-3809fbe74e95', 'volume_size': 1}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=022fc2bb-d497-48f0-91b3-3809fbe74e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6762cc5f1f3c4846aa0b0889d6d7b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:22Z,use_quota=True,user_id='d54aa6612ce94bebad4da2925de6702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Creating volume 022fc2bb-d497-48f0-91b3-3809fbe74e95 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:21 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:21 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af" returned: 0 in 0.975s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:21 devstack sudo[106116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95 1073741824
Jul 06 21:10:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:21 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:22 devstack sudo[106118]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af
Jul 06 21:10:22 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (ae61cf34-08f7-430a-bd0a-35168b7519f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809ffb32-397b-4a95-b97a-8d408f47b097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809ffb32-397b-4a95-b97a-8d408f47b097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455180391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f871785-61d7-4f15-ad55-8430a42f907c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c23751b-3af6-489d-9636-9b9c75f1bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c23751b-3af6-489d-9636-9b9c75f1bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef08be44-9e0b-4ebd-8eb9-2be508f47cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef08be44-9e0b-4ebd-8eb9-2be508f47cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f871785-61d7-4f15-ad55-8430a42f907c', 'volume_name': 'volume-3f871785-61d7-4f15-ad55-8430a42f907c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d216863f-9445-4fb8-a2c7-7bf1a5496e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d216863f-9445-4fb8-a2c7-7bf1a5496e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8251b3e-320a-4e8c-9291-188a77699a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:22 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume 3f871785-61d7-4f15-ad55-8430a42f907c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f871785-61d7-4f15-ad55-8430a42f907c', 'volume_size': 1}
Jul 06 21:10:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:23 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a8370161-4f25-4f15-a1bb-efdd30bc44af" returned: 0 in 1.035s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-quobyte-a8370161-4f25-4f15-a1bb-efdd30bc44af" released by "delete_volume" :: held 2.064s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Created reservations ['d773369e-2d33-4f1e-a694-4022985bf5b7', 'd619b63d-f7ef-49b8-9785-93822ad542d8', '4f6e01ec-05e9-413b-9404-9d11fe29d5a7', 'c643fa2a-e048-483a-85f8-031ead38bcc9'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:23 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95 1073741824" returned: 0 in 1.349s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:23 devstack sudo[106131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (938441a1-ad99-4369-80e9-4225c84e948a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:23 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcaf1f9-b822-4c6e-9bb6-9df27cbd9a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bcaf1f9-b822-4c6e-9bb6-9df27cbd9a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1131273739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33a18cb-bb36-47a1-926a-0131924fbd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41303e43-540b-4a3a-bd2a-7162d0e6ffbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41303e43-540b-4a3a-bd2a-7162d0e6ffbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da688352-e859-4a5e-bb7e-61f8113f3f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da688352-e859-4a5e-bb7e-61f8113f3f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd33a18cb-bb36-47a1-926a-0131924fbd41', 'volume_name': 'volume-d33a18cb-bb36-47a1-926a-0131924fbd41', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3dd74b-200f-40cb-a3c7-9042ed228a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f3dd74b-200f-40cb-a3c7-9042ed228a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b4f1f4-512a-468b-be0b-1efb17caece1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume d33a18cb-bb36-47a1-926a-0131924fbd41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d33a18cb-bb36-47a1-926a-0131924fbd41', 'volume_size': 1}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:23 devstack sudo[106133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95
Jul 06 21:10:23 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (1d11007a-fd65-4e86-a28f-9a94f87c4c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335dcf5-5414-45b5-b2f4-fad5943dfde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b335dcf5-5414-45b5-b2f4-fad5943dfde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-695414274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcafb07-ca31-450e-af75-2a470c650bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fe140b-2381-4017-9e4d-aa623b0a2cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fe140b-2381-4017-9e4d-aa623b0a2cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae6d49c-4281-4579-81e4-5d52ff32a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae6d49c-4281-4579-81e4-5d52ff32a536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bcafb07-ca31-450e-af75-2a470c650bfb', 'volume_name': 'volume-1bcafb07-ca31-450e-af75-2a470c650bfb', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14609c19-155f-43a6-aaf8-c3a8325d22c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14609c19-155f-43a6-aaf8-c3a8325d22c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60722547-0e18-4923-9676-3eedae6a86b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume 1bcafb07-ca31-450e-af75-2a470c650bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bcafb07-ca31-450e-af75-2a470c650bfb', 'volume_size': 1}
Jul 06 21:10:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (548c311d-3539-4195-81ea-38b411ac7d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6ac424-1a38-4ba2-a8da-954d264b9232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6ac424-1a38-4ba2-a8da-954d264b9232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304522459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ced6f7a-609c-4994-8fd7-6b9e74b7b400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd6213e-6eaa-42ce-bf2a-88a2b5984241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dd6213e-6eaa-42ce-bf2a-88a2b5984241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a9836e-6ac8-43d0-b39f-11fac342182d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1a9836e-6ac8-43d0-b39f-11fac342182d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ced6f7a-609c-4994-8fd7-6b9e74b7b400', 'volume_name': 'volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bbe8bc-a361-46ac-bc65-e9ac24b9ca03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11bbe8bc-a361-46ac-bc65-e9ac24b9ca03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:24 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0432e45-2658-49fd-b151-39a602db3ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:24 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume 2ced6f7a-609c-4994-8fd7-6b9e74b7b400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400', 'volume_size': 1}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95" returned: 0 in 1.011s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] <== create_volume: return (2532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.534s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1455180391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f871785-61d7-4f15-ad55-8430a42f907c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Creating volume 3f871785-61d7-4f15-ad55-8430a42f907c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:24 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b017ef56-ea40-4b8b-89cd-769996f0a39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-022fc2bb-d497-48f0-91b3-3809fbe74e95', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:24 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a82f17-e631-44fc-bdc3-6adcc5db82d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.222s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:24 devstack sudo[106137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c 1073741824
Jul 06 21:10:24 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:24 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Deleted volume successfully.
Jul 06 21:10:24 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Volume volume-022fc2bb-d497-48f0-91b3-3809fbe74e95 (022fc2bb-d497-48f0-91b3-3809fbe74e95): created successfully
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7a82f17-e631-44fc-bdc3-6adcc5db82d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Flow 'volume_create_manager' (2921067c-4e6e-4b22-b27e-4dc4e1f81a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:24 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ee011395-4f13-4c5d-9bc3-ddbddcb1527f tempest-CinderUnicodeTest-1713208131 None] Created volume successfully.
Jul 06 21:10:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bed176b7-c16c-45fd-b700-a8aaf647398c tempest-CreateVolumesFromSourceVolumeTest-746673145 None] Lock "cinder-a8370161-4f25-4f15-a1bb-efdd30bc44af-delete_volume" released by "delete_volume" :: held 3.726s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (ab876d09-b6d6-4fd9-8042-07252cd4923a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f26ebc6-8669-442b-b10f-302d3dd662cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f26ebc6-8669-442b-b10f-302d3dd662cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-579109371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2639c3-b969-44c5-9969-f5be79effebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:25Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e7e6e7-e403-4834-9632-4a5cd836c9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64e7e6e7-e403-4834-9632-4a5cd836c9e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d4c69c-b248-4329-ac0f-97766abc656d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d4c69c-b248-4329-ac0f-97766abc656d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2639c3-b969-44c5-9969-f5be79effebe', 'volume_name': 'volume-0b2639c3-b969-44c5-9969-f5be79effebe', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b1fe0a-816d-46c2-9c3d-4858a588ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08b1fe0a-816d-46c2-9c3d-4858a588ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bf2f21-7bd3-4101-a4d9-6522a97deeb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume 0b2639c3-b969-44c5-9969-f5be79effebe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2639c3-b969-44c5-9969-f5be79effebe', 'volume_size': 1}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:25 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c 1073741824" returned: 0 in 1.405s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Flow 'volume_create_manager' (c43fe351-b4b2-474f-b2d7-5b2bfcaf318d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558eec8c-3f7e-4d0d-90c4-adead7d72499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (558eec8c-3f7e-4d0d-90c4-adead7d72499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-452950061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23db46af-fc03-4150-9b6e-bad11c049691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6762cc5f1f3c4846aa0b0889d6d7b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:26Z,use_quota=True,user_id='d54aa6612ce94bebad4da2925de6702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3c675b-5ee4-4c30-8337-f59c8142af68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3c675b-5ee4-4c30-8337-f59c8142af68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5f4c54-58bf-4757-a4a8-ffd4d9fe29f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e5f4c54-58bf-4757-a4a8-ffd4d9fe29f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23db46af-fc03-4150-9b6e-bad11c049691', 'volume_name': 'volume-23db46af-fc03-4150-9b6e-bad11c049691', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a0cf37-f53e-4101-92c1-ae06aa9eff3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a0cf37-f53e-4101-92c1-ae06aa9eff3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209bc8eb-b55e-4c77-9246-0a119c5fc417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Volume 23db46af-fc03-4150-9b6e-bad11c049691: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23db46af-fc03-4150-9b6e-bad11c049691', 'volume_size': 1}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:26 devstack sudo[106143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c
Jul 06 21:10:26 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (b641c886-fe3c-4cea-a4b0-5abe06139e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba31be-4123-4e21-986e-2d6b8aabb906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1ba31be-4123-4e21-986e-2d6b8aabb906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709697264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ad61a9-acab-40d7-af6a-4e84494de099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:26Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3137f245-c992-4a9e-930c-598af7230324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3137f245-c992-4a9e-930c-598af7230324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bac7d9-2502-41e2-87de-ae1ed9c164b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1bac7d9-2502-41e2-87de-ae1ed9c164b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ad61a9-acab-40d7-af6a-4e84494de099', 'volume_name': 'volume-11ad61a9-acab-40d7-af6a-4e84494de099', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a081f5a9-50f3-4340-870d-9c04b1be70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a081f5a9-50f3-4340-870d-9c04b1be70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f17a75-921a-4c5d-a894-6face8cfb5c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Volume 11ad61a9-acab-40d7-af6a-4e84494de099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ad61a9-acab-40d7-af6a-4e84494de099', 'volume_size': 1}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:26 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c" returned: 0 in 0.862s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.423s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.458s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1131273739',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d33a18cb-bb36-47a1-926a-0131924fbd41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:23Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Creating volume d33a18cb-bb36-47a1-926a-0131924fbd41 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:26 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8251b3e-320a-4e8c-9291-188a77699a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f871785-61d7-4f15-ad55-8430a42f907c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:26 devstack sudo[106146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41 1073741824
Jul 06 21:10:26 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5ea6ed-b4e1-4193-b454-9dfabdc07082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume volume-3f871785-61d7-4f15-ad55-8430a42f907c (3f871785-61d7-4f15-ad55-8430a42f907c): created successfully
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d5ea6ed-b4e1-4193-b454-9dfabdc07082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (ae61cf34-08f7-430a-bd0a-35168b7519f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ee06b429-a93d-44c9-a21b-639999022ddc tempest-CreateVolumesFromSnapshotTest-454551454 None] Created volume successfully.
Jul 06 21:10:27 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41 1073741824" returned: 0 in 0.950s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:27 devstack sudo[106152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41
Jul 06 21:10:27 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Flow 'volume_create_manager' (950b124e-b86d-4a16-860e-92729f6eac62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ef6938-2013-4f31-9064-d5a5970a2803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54ef6938-2013-4f31-9064-d5a5970a2803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1434747660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab32c57-e5c7-41f3-8a59-586b0c548290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153b026738814e938510372cf5ef954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:28Z,use_quota=True,user_id='aba9cc4be6e94181bc7dc129d0e4bfb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1cd466-909d-4602-8efd-3b7c0ca790f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf1cd466-909d-4602-8efd-3b7c0ca790f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff19d285-2c2a-46a2-b675-f57943d55ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff19d285-2c2a-46a2-b675-f57943d55ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ab32c57-e5c7-41f3-8a59-586b0c548290', 'volume_name': 'volume-2ab32c57-e5c7-41f3-8a59-586b0c548290', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30838cb5-02da-46fd-b23d-6fb6b38a44d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30838cb5-02da-46fd-b23d-6fb6b38a44d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33033324-3794-4e16-920c-d01dd900b210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:28 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Volume 2ab32c57-e5c7-41f3-8a59-586b0c548290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ab32c57-e5c7-41f3-8a59-586b0c548290', 'volume_size': 1}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:28 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41" returned: 0 in 0.690s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.710s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-695414274',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bcafb07-ca31-450e-af75-2a470c650bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Creating volume 1bcafb07-ca31-450e-af75-2a470c650bfb {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:28 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:28 devstack sudo[106156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb 1073741824
Jul 06 21:10:28 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b4f1f4-512a-468b-be0b-1efb17caece1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d33a18cb-bb36-47a1-926a-0131924fbd41', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9131a8fe-0925-46a5-9228-ccd616273b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:28 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume volume-d33a18cb-bb36-47a1-926a-0131924fbd41 (d33a18cb-bb36-47a1-926a-0131924fbd41): created successfully
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9131a8fe-0925-46a5-9228-ccd616273b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (938441a1-ad99-4369-80e9-4225c84e948a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:28 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-7a627eb5-aa1e-4ed0-9c9b-375fc1d43188 tempest-CreateVolumesFromSnapshotTest-454551454 None] Created volume successfully.
Jul 06 21:10:29 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb 1073741824" returned: 0 in 0.874s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:29 devstack sudo[106162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb
Jul 06 21:10:29 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:30 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb" returned: 0 in 0.663s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.724s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304522459',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ced6f7a-609c-4994-8fd7-6b9e74b7b400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:24Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Creating volume 2ced6f7a-609c-4994-8fd7-6b9e74b7b400 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:30 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:30 devstack sudo[106165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400 1073741824
Jul 06 21:10:30 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60722547-0e18-4923-9676-3eedae6a86b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bcafb07-ca31-450e-af75-2a470c650bfb', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1774eb-8756-4f16-bd12-01482b7ed740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:30 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume volume-1bcafb07-ca31-450e-af75-2a470c650bfb (1bcafb07-ca31-450e-af75-2a470c650bfb): created successfully
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1774eb-8756-4f16-bd12-01482b7ed740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:30 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (1d11007a-fd65-4e86-a28f-9a94f87c4c33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-39a660aa-4a5c-433a-b805-271137ea32c9 tempest-CreateVolumesFromSnapshotTest-454551454 None] Created volume successfully.
Jul 06 21:10:31 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400 1073741824" returned: 0 in 0.916s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:31 devstack sudo[106170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400
Jul 06 21:10:31 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:31 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400" returned: 0 in 0.699s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] <== create_volume: return (1668ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.631s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-579109371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2639c3-b969-44c5-9969-f5be79effebe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9359b232268e4480b900fc5b7aae8855',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:25Z,use_quota=True,user_id='30589dc4ff214b9a82ff10b4c1718fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Creating volume 0b2639c3-b969-44c5-9969-f5be79effebe {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:31 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:31 devstack sudo[106173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe 1073741824
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0432e45-2658-49fd-b151-39a602db3ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:31 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d254897-aebc-43bd-946f-ad12ad1ef7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:31 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400 (2ced6f7a-609c-4994-8fd7-6b9e74b7b400): created successfully
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d254897-aebc-43bd-946f-ad12ad1ef7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (548c311d-3539-4195-81ea-38b411ac7d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-df0bd575-a562-4115-80bb-83b14285b438 tempest-CreateVolumesFromSnapshotTest-454551454 None] Created volume successfully.
Jul 06 21:10:32 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe 1073741824" returned: 0 in 0.917s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:32 devstack sudo[106178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe
Jul 06 21:10:32 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:33 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe" returned: 0 in 0.701s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.513s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:25Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-452950061',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23db46af-fc03-4150-9b6e-bad11c049691,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6762cc5f1f3c4846aa0b0889d6d7b6bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:26Z,use_quota=True,user_id='d54aa6612ce94bebad4da2925de6702a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Creating volume 23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:33 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:33 devstack sudo[106181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 1073741824
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bf2f21-7bd3-4101-a4d9-6522a97deeb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2639c3-b969-44c5-9969-f5be79effebe', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:33 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186fe6a5-f1e1-4ca6-b5d6-a4542394418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:33 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Volume volume-0b2639c3-b969-44c5-9969-f5be79effebe (0b2639c3-b969-44c5-9969-f5be79effebe): created successfully
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186fe6a5-f1e1-4ca6-b5d6-a4542394418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Flow 'volume_create_manager' (ab876d09-b6d6-4fd9-8042-07252cd4923a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:33 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-92c3f943-52ba-4448-a377-12520be641ca tempest-CreateVolumesFromSnapshotTest-454551454 None] Created volume successfully.
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-0b2639c3-b969-44c5-9969-f5be79effebe-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-0b2639c3-b969-44c5-9969-f5be79effebe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-0b2639c3-b969-44c5-9969-f5be79effebe" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-0b2639c3-b969-44c5-9969-f5be79effebe" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1598e184-e1c9-4120-ac6e-b93da06bedde]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:33 devstack sudo[106183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe
Jul 06 21:10:33 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:34 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 1073741824" returned: 0 in 0.906s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:34 devstack sudo[106189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691
Jul 06 21:10:34 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:34 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe" returned: 0 in 0.867s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:34 devstack sudo[106194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe
Jul 06 21:10:34 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:35 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691" returned: 0 in 0.673s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.713s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-709697264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ad61a9-acab-40d7-af6a-4e84494de099,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:26Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Creating volume 11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:35 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:35 devstack sudo[106197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 1073741824
Jul 06 21:10:35 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (209bc8eb-b55e-4c77-9246-0a119c5fc417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23db46af-fc03-4150-9b6e-bad11c049691', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1450a308-8214-4eb9-ad52-078be289adf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:35 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Volume volume-23db46af-fc03-4150-9b6e-bad11c049691 (23db46af-fc03-4150-9b6e-bad11c049691): created successfully
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1450a308-8214-4eb9-ad52-078be289adf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Flow 'volume_create_manager' (c43fe351-b4b2-474f-b2d7-5b2bfcaf318d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6c37977a-c556-44ea-a668-32ad13be490a tempest-CinderUnicodeTest-1713208131 None] Created volume successfully.
Jul 06 21:10:35 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0b2639c3-b969-44c5-9969-f5be79effebe" returned: 0 in 0.711s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-0b2639c3-b969-44c5-9969-f5be79effebe" released by "delete_volume" :: held 1.632s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=132,cinder:INSERT=52,cinder:UPDATE=177,cinder:DELETE=15 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Created reservations ['b8a7dfd8-8429-4185-8c71-6833ed6e2611', '67974679-0200-4997-bb32-e86dafc276b7', 'f70b8f46-bb49-4919-8451-1817b5e82710', '5f6efb58-b38a-4f34-9216-e20bc3a3f8fc'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:35 devstack sudo[106200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:35 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-2ced6f7a-609c-4994-8fd7-6b9e74b7b400-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-2ced6f7a-609c-4994-8fd7-6b9e74b7b400-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-2ced6f7a-609c-4994-8fd7-6b9e74b7b400" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-2ced6f7a-609c-4994-8fd7-6b9e74b7b400" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579afb6-9e80-4f5b-ba7e-5a914dd57a7a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:36 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 1073741824" returned: 0 in 0.959s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=127,cinder:UPDATE=176,cinder:DELETE=20,cinder:INSERT=43 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:36 devstack sudo[106208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099
Jul 06 21:10:36 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:36 devstack sudo[106207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400
Jul 06 21:10:36 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:36 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.819s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:36 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Deleted volume successfully.
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-471cc946-9a26-4c5b-8601-19b8a57f8441 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-0b2639c3-b969-44c5-9969-f5be79effebe-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:36 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099" returned: 0 in 0.761s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.750s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1434747660',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ab32c57-e5c7-41f3-8a59-586b0c548290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153b026738814e938510372cf5ef954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:28Z,use_quota=True,user_id='aba9cc4be6e94181bc7dc129d0e4bfb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Creating volume 2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:36 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:36 devstack sudo[106216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 1073741824
Jul 06 21:10:36 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62f17a75-921a-4c5d-a894-6face8cfb5c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ad61a9-acab-40d7-af6a-4e84494de099', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab43686-09da-48b4-b242-7c8b70b1a261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:37 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:37 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Volume volume-11ad61a9-acab-40d7-af6a-4e84494de099 (11ad61a9-acab-40d7-af6a-4e84494de099): created successfully
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab43686-09da-48b4-b242-7c8b70b1a261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (b641c886-fe3c-4cea-a4b0-5abe06139e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400" returned: 0 in 0.920s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-3e63a395-1865-46c4-989f-ab282840f7e2 tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:10:37 devstack sudo[106218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400
Jul 06 21:10:37 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:37 devstack sudo[106224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:37 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:37 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ced6f7a-609c-4994-8fd7-6b9e74b7b400" returned: 0 in 0.692s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-2ced6f7a-609c-4994-8fd7-6b9e74b7b400" released by "delete_volume" :: held 1.654s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Created reservations ['55aa8a16-e2dd-4bc1-80b5-53657abdcef3', 'c7a79ea1-e5d9-4de8-874a-d3b37a057509', '198170ae-5f7a-419b-b53d-c95cadaaa710', 'de5b849c-b226-4d6d-819a-e21635280c64'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:37 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 1073741824" returned: 0 in 0.923s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:37 devstack sudo[106227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:37 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:37 devstack sudo[106229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290
Jul 06 21:10:37 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-1bcafb07-ca31-450e-af75-2a470c650bfb-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-1bcafb07-ca31-450e-af75-2a470c650bfb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-1bcafb07-ca31-450e-af75-2a470c650bfb" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-1bcafb07-ca31-450e-af75-2a470c650bfb" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f36bee7-6ee7-4225-a09c-26dc13d0c941]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:38 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.878s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:10:38 devstack sudo[106233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb
Jul 06 21:10:38 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:38 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.883s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Deleted volume successfully.
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cc2e879a-80a0-455d-bd63-6efe9803270e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-2ced6f7a-609c-4994-8fd7-6b9e74b7b400-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:38 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290" returned: 0 in 0.867s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.942s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Creating offline snapshot 9fea6b64-1469-4c7b-a54d-20a7ae9038f0 of volume 23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33033324-3794-4e16-920c-d01dd900b210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ab32c57-e5c7-41f3-8a59-586b0c548290', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4a752f-36b4-4081-aa19-84de6a9f6733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1c2b81-499e-4cdb-a2a5-536a7806946b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Volume volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 (2ab32c57-e5c7-41f3-8a59-586b0c548290): created successfully
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c4a752f-36b4-4081-aa19-84de6a9f6733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Flow 'volume_create_manager' (950b124e-b86d-4a16-860e-92729f6eac62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-746ddfcd-4e0b-4ee5-b998-fc1a1a566aec tempest-VolumeDependencyTests-695248484 None] Created volume successfully.
Jul 06 21:10:38 devstack sudo[106238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691
Jul 06 21:10:38 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:39 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb" returned: 0 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:39 devstack sudo[106243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb
Jul 06 21:10:39 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:39 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:39 devstack sudo[106248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 1G
Jul 06 21:10:39 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:40 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1bcafb07-ca31-450e-af75-2a470c650bfb" returned: 0 in 0.730s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-1bcafb07-ca31-450e-af75-2a470c650bfb" released by "delete_volume" :: held 1.643s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Created reservations ['947dc5cf-55df-4ba3-824c-3d42d00cb029', '5d0ebb46-e71d-4eb1-af42-8c2f16d7fee7', 'd7328330-ee5d-4555-a802-614856aa85c4', 'f62aa432-537e-4b53-a3f5-76896095b7ae'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:40 devstack sudo[106253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:40 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:40 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 1G" returned: 0 in 0.879s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23db46af-fc03-4150-9b6e-bad11c049691 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:40 devstack sudo[106257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23db46af-fc03-4150-9b6e-bad11c049691 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0
Jul 06 21:10:40 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-d33a18cb-bb36-47a1-926a-0131924fbd41-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-d33a18cb-bb36-47a1-926a-0131924fbd41-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-d33a18cb-bb36-47a1-926a-0131924fbd41" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-d33a18cb-bb36-47a1-926a-0131924fbd41" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f72ff13-439a-41a5-8845-d57f9b8b0466]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:40 devstack sudo[106259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41
Jul 06 21:10:40 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:40 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.736s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:40 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:40 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Deleted volume successfully.
Jul 06 21:10:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-caf435cb-5696-47c3-9f0f-1009a39e131e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-1bcafb07-ca31-450e-af75-2a470c650bfb-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:41 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-23db46af-fc03-4150-9b6e-bad11c049691 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0" returned: 0 in 0.859s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:41 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 is being set with open permissions: ugo+rw
Jul 06 21:10:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:41 devstack sudo[106267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0
Jul 06 21:10:41 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:41 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41" returned: 0 in 0.852s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:41 devstack sudo[106272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41
Jul 06 21:10:41 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:42 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0" returned: 0 in 0.684s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:42 devstack sudo[106275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.info
Jul 06 21:10:42 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:42 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d33a18cb-bb36-47a1-926a-0131924fbd41" returned: 0 in 0.671s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-d33a18cb-bb36-47a1-926a-0131924fbd41" released by "delete_volume" :: held 1.568s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Created reservations ['8d23c0df-b090-498f-825a-2d6d79dd2bfe', '3a1ab1a6-d092-4d03-8d9f-a22b0e65404b', 'e7ff455d-75a4-4dc3-82ef-c467eb4f60a1', 'ef175067-0bc0-49d1-b0c7-34859f18adac'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:42 devstack sudo[106278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:42 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:42 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.info" returned: 0 in 0.731s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:42 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.info is being set with open permissions: ugo+rw
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:42 devstack sudo[106281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.info
Jul 06 21:10:42 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-3f871785-61d7-4f15-ad55-8430a42f907c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-3f871785-61d7-4f15-ad55-8430a42f907c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-3f871785-61d7-4f15-ad55-8430a42f907c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-3f871785-61d7-4f15-ad55-8430a42f907c" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a236a5e-557d-4711-a101-a9ed0c3fc698]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:43 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.672s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Deleted volume successfully.
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5bbf57ce-1fbd-4071-94f9-6f60c621e773 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-d33a18cb-bb36-47a1-926a-0131924fbd41-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:43 devstack sudo[106284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c
Jul 06 21:10:43 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:43 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.info" returned: 0 in 0.726s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.819s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.089s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Creating offline snapshot 2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 of volume 11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfae899-65aa-4bd3-a100-e284292fe962]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-348e0075-7b7a-4e8f-be22-316118aa8a69 tempest-CinderUnicodeTest-1713208131 None] Create snapshot completed successfully
Jul 06 21:10:43 devstack sudo[106287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099
Jul 06 21:10:43 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:43 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c" returned: 0 in 0.853s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:43 devstack sudo[106292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c
Jul 06 21:10:43 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "cinder-9fea6b64-1469-4c7b-a54d-20a7ae9038f0-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-9fea6b64-1469-4c7b-a54d-20a7ae9038f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "cinder-quobyte-23db46af-fc03-4150-9b6e-bad11c049691" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-23db46af-fc03-4150-9b6e-bad11c049691" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "cinder-quobyte-9fea6b64-1469-4c7b-a54d-20a7ae9038f0" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-9fea6b64-1469-4c7b-a54d-20a7ae9038f0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Deleting offline snapshot 9fea6b64-1469-4c7b-a54d-20a7ae9038f0 of volume 23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] snapshot_file for this snap is: volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d87b5a-c380-4a41-a43e-99765e3dcf4c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:44 devstack sudo[106294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0
Jul 06 21:10:44 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:44 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099" returned: 0 in 0.856s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:44 devstack sudo[106300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 1G
Jul 06 21:10:44 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:44 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-3f871785-61d7-4f15-ad55-8430a42f907c" returned: 0 in 0.729s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-3f871785-61d7-4f15-ad55-8430a42f907c" released by "delete_volume" :: held 1.640s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Created reservations ['67907c76-fa66-4b6e-8e60-92959c613afe', 'b42bf8dc-0281-4c0f-b636-4893182ddb7b', 'ef8defeb-16b9-4bad-b7ce-ccfcb2ac523e', '2e35df0b-94db-41a5-aa55-9a602d893126'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:44 devstack sudo[106302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:44 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:45 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0" returned: 0 in 0.832s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-23db46af-fc03-4150-9b6e-bad11c049691(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-18853d8c-104e-46f9-b581-f5ca9e6f4676-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f988c1-d044-4c17-b283-b989395e86bd]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-18853d8c-104e-46f9-b581-f5ca9e6f4676-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-abf0290f-8b24-45d5-b288-2d1c05f67cdb" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-abf0290f-8b24-45d5-b288-2d1c05f67cdb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-18853d8c-104e-46f9-b581-f5ca9e6f4676" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-18853d8c-104e-46f9-b581-f5ca9e6f4676" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Deleting offline snapshot 18853d8c-104e-46f9-b581-f5ca9e6f4676 of volume abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] snapshot_file for this snap is: volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[865813bb-6fd1-4173-9f08-4fd890ccf24c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:45 devstack sudo[106310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691
Jul 06 21:10:45 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:45 devstack sudo[106312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676
Jul 06 21:10:45 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:45 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 1G" returned: 0 in 1.006s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ad61a9-acab-40d7-af6a-4e84494de099 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:45 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.739s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Deleted volume successfully.
Jul 06 21:10:45 devstack sudo[106316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ad61a9-acab-40d7-af6a-4e84494de099 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46
Jul 06 21:10:45 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-53048619-6d5b-4063-ab30-da0d05a2983a tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-3f871785-61d7-4f15-ad55-8430a42f907c-delete_volume" released by "delete_volume" :: held 2.627s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:46 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691" returned: 0 in 0.813s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:46 devstack sudo[106321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0
Jul 06 21:10:46 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:46 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676" returned: 0 in 0.886s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:10:46 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ad61a9-acab-40d7-af6a-4e84494de099 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" returned: 0 in 0.738s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:46 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 is being set with open permissions: ugo+rw
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[65703885-3c2e-4db3-b49b-affa9590d6cd]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:46 devstack sudo[106330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46
Jul 06 21:10:46 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:46 devstack sudo[106331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb
Jul 06 21:10:46 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:46 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0" returned: 0 in 0.784s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:46 devstack sudo[106337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0
Jul 06 21:10:46 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:46 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" returned: 0 in 0.711s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:47 devstack sudo[106343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.info
Jul 06 21:10:47 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:47 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb" returned: 0 in 0.815s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:47 devstack sudo[106345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676
Jul 06 21:10:47 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:47 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691.9fea6b64-1469-4c7b-a54d-20a7ae9038f0" returned: 0 in 0.674s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-9fea6b64-1469-4c7b-a54d-20a7ae9038f0" released by "_delete_snapshot" :: held 3.257s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-23db46af-fc03-4150-9b6e-bad11c049691" released by "delete_snapshot" :: held 3.282s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Created reservations ['b8145f42-d74e-4bb8-b83e-d73a04419424', 'ba015f7f-bccf-4157-be82-9606dfac96d8', '132db41e-a36f-431c-8189-a457d141708e', 'a4e3cd04-5193-48ec-bbaa-f89094ae4b02'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Delete snapshot completed successfully.
Jul 06 21:10:47 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6fb9231a-defd-4d7b-abc4-c72ecded4f3c tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-9fea6b64-1469-4c7b-a54d-20a7ae9038f0-delete_snapshot" released by "delete_snapshot" :: held 3.450s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.info" returned: 0 in 0.681s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:47 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.info is being set with open permissions: ugo+rw
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:47 devstack sudo[106351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.info
Jul 06 21:10:47 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:47 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676" returned: 0 in 0.803s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:47 devstack sudo[106354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676
Jul 06 21:10:47 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:48 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.info" returned: 0 in 0.662s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.331s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Creating offline snapshot 59053285-432e-426d-afd1-7dac99ed8439 of volume 2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:10:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-24fd074b-bafd-4a29-b5ae-fc4cbf0f2ebb tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d7946a-9f73-40f2-b8f6-8fb279636fa0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "cinder-23db46af-fc03-4150-9b6e-bad11c049691-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-23db46af-fc03-4150-9b6e-bad11c049691-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "cinder-quobyte-23db46af-fc03-4150-9b6e-bad11c049691" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-23db46af-fc03-4150-9b6e-bad11c049691" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:48 devstack sudo[106358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290
Jul 06 21:10:48 devstack sudo[106358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:48 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb.18853d8c-104e-46f9-b581-f5ca9e6f4676" returned: 0 in 0.698s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8824800a-6f84-4ba8-8266-c9bc6c30ddbc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-18853d8c-104e-46f9-b581-f5ca9e6f4676" released by "_delete_snapshot" :: held 3.348s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-abf0290f-8b24-45d5-b288-2d1c05f67cdb" released by "delete_snapshot" :: held 3.378s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Created reservations ['c07a0970-d63f-4137-b632-f3c9bc33b420', '240159fb-0ea0-4e09-8f5f-41cdf9cfc35e', 'f6b9549a-ff44-4a91-90cf-f00a45015635', '5f3079b0-aaa0-4d32-8d7f-8e4032c0c269'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:48 devstack sudo[106361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691
Jul 06 21:10:48 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Delete snapshot completed successfully.
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f4377a24-b2f3-4528-b450-ab8803ded62e tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-18853d8c-104e-46f9-b581-f5ca9e6f4676-delete_snapshot" released by "delete_snapshot" :: held 3.548s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-2eb3270d-a17e-4bf3-a1bb-d3cf55107d46-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Lock "cinder-2eb3270d-a17e-4bf3-a1bb-d3cf55107d46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-11ad61a9-acab-40d7-af6a-4e84494de099" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-11ad61a9-acab-40d7-af6a-4e84494de099" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot 2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 of volume 11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c5ab42-59e2-4584-b82f-d79626a0004e]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:49 devstack sudo[106363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46
Jul 06 21:10:49 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:49 devstack sudo[106358]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290" returned: 0 in 0.936s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:49 devstack sudo[106372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 1G
Jul 06 21:10:49 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:49 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691" returned: 0 in 0.855s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-abf0290f-8b24-45d5-b288-2d1c05f67cdb-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:49 devstack sudo[106374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691
Jul 06 21:10:49 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-abf0290f-8b24-45d5-b288-2d1c05f67cdb-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "cinder-quobyte-abf0290f-8b24-45d5-b288-2d1c05f67cdb" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-abf0290f-8b24-45d5-b288-2d1c05f67cdb" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[de01860d-a444-4ce3-8269-aab5b47d6904]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:49 devstack sudo[106376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb
Jul 06 21:10:49 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:49 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" returned: 0 in 0.880s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ad61a9-acab-40d7-af6a-4e84494de099(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f8180-3a4c-4566-bf3c-f14d15492d97]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:49 devstack sudo[106382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099
Jul 06 21:10:49 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:50 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-23db46af-fc03-4150-9b6e-bad11c049691" returned: 0 in 0.816s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-23db46af-fc03-4150-9b6e-bad11c049691" released by "delete_volume" :: held 1.740s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Created reservations ['6fe2c019-0739-41dd-904e-d2bcb6900357', '13c40251-7438-425c-9d50-1a5af115b06e', 'f06ed160-80a2-41c3-85ca-613aacfd9d2e', '9c1586eb-4ee1-45d0-8e1e-5300f86fc03c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:50 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 1G" returned: 0 in 1.076s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:50 devstack sudo[106392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:50 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:50 devstack sudo[106393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439
Jul 06 21:10:50 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:50 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb" returned: 0 in 0.886s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:50 devstack sudo[106396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb
Jul 06 21:10:50 devstack sudo[106396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "cinder-022fc2bb-d497-48f0-91b3-3809fbe74e95-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-022fc2bb-d497-48f0-91b3-3809fbe74e95-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:50 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099" returned: 0 in 1.031s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:50 devstack sudo[106401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46
Jul 06 21:10:50 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "cinder-quobyte-022fc2bb-d497-48f0-91b3-3809fbe74e95" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-022fc2bb-d497-48f0-91b3-3809fbe74e95" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3917bc4-103e-41d5-a9c1-f57611a20db0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:51 devstack sudo[106406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95
Jul 06 21:10:51 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:51 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439" returned: 0 in 0.896s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:51 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 is being set with open permissions: ugo+rw
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:51 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:51 devstack sudo[106410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.973s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:51 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Deleted volume successfully.
Jul 06 21:10:51 devstack sudo[106396]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-abf0290f-8b24-45d5-b288-2d1c05f67cdb" returned: 0 in 0.889s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-615c3565-38bd-4aa0-a5af-1ac94a10dbf9 tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-23db46af-fc03-4150-9b6e-bad11c049691-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-quobyte-abf0290f-8b24-45d5-b288-2d1c05f67cdb" released by "delete_volume" :: held 1.873s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Created reservations ['0b1c1873-1d39-43a4-9ff8-afe37aeb800f', '84675ee5-de9f-4bde-b177-1be6a42bb732', 'f65084d6-2822-46c2-ad7a-cb954cac4cba', '57c53998-9ad7-4daa-8307-778df34229ba'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:51 devstack sudo[106415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:51 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:52 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" returned: 0 in 1.195s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:52 devstack sudo[106421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46
Jul 06 21:10:52 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:52 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439" returned: 0 in 0.818s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:52 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95" returned: 0 in 1.111s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:52 devstack sudo[106423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.info
Jul 06 21:10:52 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:52 devstack sudo[106425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95
Jul 06 21:10:52 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:52 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.181s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Deleted volume successfully.
Jul 06 21:10:52 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c76476ca-7b06-4aa9-b02a-1da4048aca55 tempest-CreateVolumesFromSnapshotTest-454551454 None] Lock "cinder-abf0290f-8b24-45d5-b288-2d1c05f67cdb-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:53 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099.2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" returned: 0 in 1.032s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:53 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-022fc2bb-d497-48f0-91b3-3809fbe74e95" returned: 0 in 0.936s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-2eb3270d-a17e-4bf3-a1bb-d3cf55107d46" released by "_delete_snapshot" :: held 4.270s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-quobyte-022fc2bb-d497-48f0-91b3-3809fbe74e95" released by "delete_volume" :: held 2.101s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-11ad61a9-acab-40d7-af6a-4e84494de099" released by "delete_snapshot" :: held 4.311s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:53 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.info" returned: 0 in 1.046s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:53 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.info is being set with open permissions: ugo+rw
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:53 devstack sudo[106431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.info
Jul 06 21:10:53 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Created reservations ['e62b59f1-16ec-43e1-a8f6-987306c94727', '47522d70-007d-460c-9d9f-dd42b3e3b9ea', 'a8d18117-485e-40b0-8f5a-4429de0ded6e', 'b759ec0b-ea67-4a67-ae79-a6da15fd91b2'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Created reservations ['4f4317e7-515b-41a6-aac5-117ab0822e61', 'c86d50d8-8c0c-415e-8f3e-d5d9fbf19882', '4b0bf791-cccc-40f0-bd55-d10cad22b8fe', '34426660-e078-4805-89d4-7ef1bb7c8668'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:53 devstack sudo[106433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:53 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:53 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:10:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ec2813f0-a918-47ce-b3e5-72292a4adc72 tempest-ProjectMemberTests-403782602 None] Lock "cinder-2eb3270d-a17e-4bf3-a1bb-d3cf55107d46-delete_snapshot" released by "delete_snapshot" :: held 4.591s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:54 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.info" returned: 0 in 0.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.694s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-581c6e3c-e49c-4d85-9b9f-a1ecea3f4fde tempest-VolumeDependencyTests-695248484 None] Create snapshot completed successfully
Jul 06 21:10:54 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.739s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Deleted volume successfully.
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d4b62922-1d8e-43a0-b9ac-75a54f8d812f tempest-CinderUnicodeTest-1713208131 None] Lock "cinder-022fc2bb-d497-48f0-91b3-3809fbe74e95-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-11ad61a9-acab-40d7-af6a-4e84494de099-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Lock "cinder-11ad61a9-acab-40d7-af6a-4e84494de099-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-11ad61a9-acab-40d7-af6a-4e84494de099" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-11ad61a9-acab-40d7-af6a-4e84494de099" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7913a5-0b68-4692-90fe-38ec920c8760]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:54 devstack sudo[106437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099
Jul 06 21:10:54 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:55 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099" returned: 0 in 1.021s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:55 devstack sudo[106442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099
Jul 06 21:10:55 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Flow 'volume_create_manager' (eef12aa9-99e7-4f7d-918a-0b3f0864324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7668ffac-c5bd-4e67-a04e-95ece3040930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7668ffac-c5bd-4e67-a04e-95ece3040930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1486896251',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a182d7c6-9e36-4eae-9c27-63ae94a14372,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='153b026738814e938510372cf5ef954e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59053285-432e-426d-afd1-7dac99ed8439,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:55Z,use_quota=True,user_id='aba9cc4be6e94181bc7dc129d0e4bfb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3f9dc1-3a8a-468c-aee2-40917122d73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3f9dc1-3a8a-468c-aee2-40917122d73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94185b66-017b-4ccd-b240-83f9ad1c1d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94185b66-017b-4ccd-b240-83f9ad1c1d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a182d7c6-9e36-4eae-9c27-63ae94a14372', 'volume_name': 'volume-a182d7c6-9e36-4eae-9c27-63ae94a14372', 'volume_size': 1, 'snapshot_id': '59053285-432e-426d-afd1-7dac99ed8439'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36d9a16-a824-4d4a-8c89-c1aff7b9ebc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b36d9a16-a824-4d4a-8c89-c1aff7b9ebc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9880bcde-3d18-4911-8734-86ecfaf645b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Volume a182d7c6-9e36-4eae-9c27-63ae94a14372: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a182d7c6-9e36-4eae-9c27-63ae94a14372', 'volume_size': 1, 'snapshot_id': '59053285-432e-426d-afd1-7dac99ed8439'}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-quobyte-59053285-432e-426d-afd1-7dac99ed8439-a182d7c6-9e36-4eae-9c27-63ae94a14372" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-59053285-432e-426d-afd1-7dac99ed8439-a182d7c6-9e36-4eae-9c27-63ae94a14372" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Creating volume a182d7c6-9e36-4eae-9c27-63ae94a14372 from snapshot 59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-quobyte-a182d7c6-9e36-4eae-9c27-63ae94a14372" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-a182d7c6-9e36-4eae-9c27-63ae94a14372" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] snapshot: 59053285-432e-426d-afd1-7dac99ed8439, volume: a182d7c6-9e36-4eae-9c27-63ae94a14372,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fc5a70-8111-41b5-a979-dd3ea892d37a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:55 devstack sudo[106444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439
Jul 06 21:10:55 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:56 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-11ad61a9-acab-40d7-af6a-4e84494de099" returned: 0 in 0.768s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-11ad61a9-acab-40d7-af6a-4e84494de099" released by "delete_volume" :: held 1.877s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Created reservations ['7f87c575-0a4c-4c25-a7ae-0717350e13af', '1239a870-1ae0-4176-ad3d-d118f4c8d97f', '38f790a5-e74f-48d9-a217-19d9731705f3', 'c66e7c02-dfb7-4be6-a42f-192250756187'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:10:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:56 devstack sudo[106447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:10:56 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:57 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439" returned: 0 in 1.162s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ab32c57-e5c7-41f3-8a59-586b0c548290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[856865a5-5abd-4ba1-89a8-fd3cb4f0a663]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:57 devstack sudo[106452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290
Jul 06 21:10:57 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (dd716207-006b-480d-9d5d-dc63bad42b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c31d55-66a7-48b9-bd14-3801be18d603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c31d55-66a7-48b9-bd14-3801be18d603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499692492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9201a81-d87f-4d30-a914-ca7b209fb65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:57Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af69caa-0501-4994-adb6-d3df25e56075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af69caa-0501-4994-adb6-d3df25e56075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc10a92-6882-41ad-97d8-bb0cff3c93dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc10a92-6882-41ad-97d8-bb0cff3c93dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9201a81-d87f-4d30-a914-ca7b209fb65b', 'volume_name': 'volume-e9201a81-d87f-4d30-a914-ca7b209fb65b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac0cb96-311e-43d6-9a87-76848fef3ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac0cb96-311e-43d6-9a87-76848fef3ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96887ec-f3f7-47c7-9626-cd6cf7b0a472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:10:57 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Volume e9201a81-d87f-4d30-a914-ca7b209fb65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9201a81-d87f-4d30-a914-ca7b209fb65b', 'volume_size': 1}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:10:57 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.030s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:10:57 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:10:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-673f3225-e896-43e3-8a88-7d6a6286b790 tempest-ProjectMemberTests-403782602 None] Lock "cinder-11ad61a9-acab-40d7-af6a-4e84494de099-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:10:58 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root
Jul 06 21:10:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290" returned: 0 in 0.973s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:10:58 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 21:10:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:10:58 devstack sudo[106458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372
Jul 06 21:10:58 devstack sudo[106458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372" returned: 0 in 5.892s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a849a8fa-a86f-4324-b7ff-b5b43dbd1f36]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:04 devstack sudo[106471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290
Jul 06 21:11:04 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:05 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290" returned: 0 in 1.116s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:11:05 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Converted 1024.00 MB image at 173.75 MB/s
Jul 06 21:11:05 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 is being set with open permissions: ugo+rw
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:05 devstack sudo[106478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372
Jul 06 21:11:05 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (9bdbc651-6ae9-44fb-beaa-af8bd50e0229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2075eef-047c-443a-9800-fb727b8a2d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2075eef-047c-443a-9800-fb727b8a2d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020663038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820cc453-ffba-49f4-bc67-c31f41194dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:06Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e943a814-dd46-4660-9f18-3d0c1b92180b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e943a814-dd46-4660-9f18-3d0c1b92180b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c482857-6bfb-4527-a25f-49452670a888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c482857-6bfb-4527-a25f-49452670a888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '820cc453-ffba-49f4-bc67-c31f41194dc5', 'volume_name': 'volume-820cc453-ffba-49f4-bc67-c31f41194dc5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30245b30-40bb-4f82-8aeb-03328f885ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30245b30-40bb-4f82-8aeb-03328f885ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f7419c-0d8b-44c3-a715-1326861c3da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:05 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Volume 820cc453-ffba-49f4-bc67-c31f41194dc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-820cc453-ffba-49f4-bc67-c31f41194dc5', 'volume_size': 1}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:05 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372" returned: 0 in 0.716s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-a182d7c6-9e36-4eae-9c27-63ae94a14372" released by "_copy_volume_from_snapshot" :: held 9.997s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-59053285-432e-426d-afd1-7dac99ed8439-a182d7c6-9e36-4eae-9c27-63ae94a14372" released by "_create_volume_from_snapshot" :: held 10.042s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.063s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.412s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-499692492',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9201a81-d87f-4d30-a914-ca7b209fb65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:57Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Creating volume e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:05 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:05 devstack sudo[106481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b 1073741824
Jul 06 21:11:05 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9880bcde-3d18-4911-8734-86ecfaf645b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a182d7c6-9e36-4eae-9c27-63ae94a14372', 'volume_size': 1, 'snapshot_id': '59053285-432e-426d-afd1-7dac99ed8439'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8031e2b8-c109-4621-82eb-6257643e222b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:05 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Volume volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 (a182d7c6-9e36-4eae-9c27-63ae94a14372): created successfully
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8031e2b8-c109-4621-82eb-6257643e222b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Flow 'volume_create_manager' (eef12aa9-99e7-4f7d-918a-0b3f0864324f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-262fa6b4-6a60-4edc-85fa-6894d41ef9e0 tempest-VolumeDependencyTests-695248484 None] Created volume successfully.
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-59053285-432e-426d-afd1-7dac99ed8439-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-59053285-432e-426d-afd1-7dac99ed8439-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-quobyte-2ab32c57-e5c7-41f3-8a59-586b0c548290" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-2ab32c57-e5c7-41f3-8a59-586b0c548290" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-quobyte-59053285-432e-426d-afd1-7dac99ed8439" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-59053285-432e-426d-afd1-7dac99ed8439" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Deleting offline snapshot 59053285-432e-426d-afd1-7dac99ed8439 of volume 2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] snapshot_file for this snap is: volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:11:06 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b 1073741824" returned: 0 in 1.021s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ae9977-3395-4d3f-bdd1-8d490ee53b87]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:06 devstack sudo[106488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b
Jul 06 21:11:06 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:06 devstack sudo[106487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439
Jul 06 21:11:06 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:07 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b" returned: 0 in 0.696s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2020663038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=820cc453-ffba-49f4-bc67-c31f41194dc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:06Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Creating volume 820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:07 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b96887ec-f3f7-47c7-9626-cd6cf7b0a472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9201a81-d87f-4d30-a914-ca7b209fb65b', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:07 devstack sudo[106495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 1073741824
Jul 06 21:11:07 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0119ad46-cb31-4263-9a10-5463b895892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:07 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Volume volume-e9201a81-d87f-4d30-a914-ca7b209fb65b (e9201a81-d87f-4d30-a914-ca7b209fb65b): created successfully
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0119ad46-cb31-4263-9a10-5463b895892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (dd716207-006b-480d-9d5d-dc63bad42b1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:07 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b625c43a-3cb8-42b2-9cd8-f6d53de4a590 tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:11:07 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439" returned: 0 in 0.896s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ab32c57-e5c7-41f3-8a59-586b0c548290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e33d1ff-51fe-4012-9819-b58dd03f2132]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:07 devstack sudo[106497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290
Jul 06 21:11:07 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:08 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 1073741824" returned: 0 in 0.869s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:08 devstack sudo[106506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5
Jul 06 21:11:08 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:08 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290" returned: 0 in 0.878s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:08 devstack sudo[106508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439
Jul 06 21:11:08 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:09 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5" returned: 0 in 0.722s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.653s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.579s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Creating offline snapshot dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 of volume e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95f7419c-0d8b-44c3-a715-1326861c3da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-820cc453-ffba-49f4-bc67-c31f41194dc5', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b192ebf2-a624-4293-87ce-3be9f4628c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f64c08c-e78a-4f24-be2e-3ce9cb3d65f7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:09 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Volume volume-820cc453-ffba-49f4-bc67-c31f41194dc5 (820cc453-ffba-49f4-bc67-c31f41194dc5): created successfully
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b192ebf2-a624-4293-87ce-3be9f4628c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (9bdbc651-6ae9-44fb-beaa-af8bd50e0229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5ebddf31-3255-40cd-86a7-dc9ec3ca7ff0 tempest-ProjectReaderTests-1922464028 None] Created volume successfully.
Jul 06 21:11:09 devstack sudo[106513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b
Jul 06 21:11:09 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:09 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:09 devstack sudo[106516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439
Jul 06 21:11:09 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:10 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b" returned: 0 in 0.909s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:10 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290.59053285-432e-426d-afd1-7dac99ed8439" returned: 0 in 0.691s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:10 devstack sudo[106523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 1G
Jul 06 21:11:10 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-59053285-432e-426d-afd1-7dac99ed8439" released by "_delete_snapshot" :: held 3.470s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-2ab32c57-e5c7-41f3-8a59-586b0c548290" released by "delete_snapshot" :: held 3.494s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Created reservations ['c4130b6e-fb0f-4a43-89be-819b7cb7f6d7', 'bfcaaa82-a799-4edd-bc5f-04f4da28d1df', '78c0c0e5-45a4-469d-86ec-a97953428cd1', '8a6a0985-5019-44ee-91a5-8e9bb2edeada'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:10 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Delete snapshot completed successfully.
Jul 06 21:11:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-bcc12d68-04e1-492d-95eb-9dd21bde16e6 tempest-VolumeDependencyTests-695248484 None] Lock "cinder-59053285-432e-426d-afd1-7dac99ed8439-delete_snapshot" released by "delete_snapshot" :: held 3.639s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:11 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 1G" returned: 0 in 0.844s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9201a81-d87f-4d30-a914-ca7b209fb65b -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-2ab32c57-e5c7-41f3-8a59-586b0c548290-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:11 devstack sudo[106529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9201a81-d87f-4d30-a914-ca7b209fb65b -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7
Jul 06 21:11:11 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Lock "cinder-2ab32c57-e5c7-41f3-8a59-586b0c548290-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-quobyte-2ab32c57-e5c7-41f3-8a59-586b0c548290" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-2ab32c57-e5c7-41f3-8a59-586b0c548290" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ed9fdf-f70b-4bb2-987e-19832e496175]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:11 devstack sudo[106531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290
Jul 06 21:11:11 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:11 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9201a81-d87f-4d30-a914-ca7b209fb65b -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" returned: 0 in 0.859s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:11 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 is being set with open permissions: ugo+rw
Jul 06 21:11:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:11 devstack sudo[106536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7
Jul 06 21:11:11 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:12 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290" returned: 0 in 0.842s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:12 devstack sudo[106541]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290
Jul 06 21:11:12 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:12 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" returned: 0 in 0.771s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:12 devstack sudo[106544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.info
Jul 06 21:11:12 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:12 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-2ab32c57-e5c7-41f3-8a59-586b0c548290" returned: 0 in 0.771s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-2ab32c57-e5c7-41f3-8a59-586b0c548290" released by "delete_volume" :: held 1.705s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Created reservations ['1f35d2d1-6264-44cb-9be9-da22d3e126dd', '5f400efa-97e2-4d4e-8fdb-3279eb2b590b', 'c99d6b38-8273-4085-be2d-1fc38ade1cf2', '04b730cc-45e9-49be-b3ac-cc6d454e7d0e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:13 devstack sudo[106547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:13 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-a182d7c6-9e36-4eae-9c27-63ae94a14372-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Lock "cinder-a182d7c6-9e36-4eae-9c27-63ae94a14372-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Acquiring lock "cinder-quobyte-a182d7c6-9e36-4eae-9c27-63ae94a14372" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-a182d7c6-9e36-4eae-9c27-63ae94a14372" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4c5112-6b0b-4fea-89e0-c3be749d0e33]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:13 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.info" returned: 0 in 0.861s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:13 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.info is being set with open permissions: ugo+rw
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:13 devstack sudo[106551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.info
Jul 06 21:11:13 devstack sudo[106551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:13 devstack sudo[106550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372
Jul 06 21:11:13 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:13 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.837s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Deleted volume successfully.
Jul 06 21:11:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4f7928bc-20aa-477b-af87-19ba2117b58c tempest-VolumeDependencyTests-695248484 None] Lock "cinder-2ab32c57-e5c7-41f3-8a59-586b0c548290-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:14 devstack sudo[106551]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.info" returned: 0 in 0.721s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.075s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Creating offline snapshot 94419f31-f3e9-4c3d-b3bc-81c24093294a of volume 820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:11:14 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8bbcce3b-a812-4623-92c8-fe18f63bcc1f tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:11:14 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372" returned: 0 in 0.874s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b2134c-a410-4fdd-864d-01a52bdaf971]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:14 devstack sudo[106559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372
Jul 06 21:11:14 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:14 devstack sudo[106560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5
Jul 06 21:11:14 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-dab77c8c-3293-4dc1-8d86-2e9e4db5edb7-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Lock "cinder-dab77c8c-3293-4dc1-8d86-2e9e4db5edb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-e9201a81-d87f-4d30-a914-ca7b209fb65b" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e9201a81-d87f-4d30-a914-ca7b209fb65b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 of volume e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[492dde2f-1df0-409c-b5d8-0b96d22fe118]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:15 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a182d7c6-9e36-4eae-9c27-63ae94a14372" returned: 0 in 0.828s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Lock "cinder-quobyte-a182d7c6-9e36-4eae-9c27-63ae94a14372" released by "delete_volume" :: held 1.774s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Created reservations ['04e65c8e-65ef-4c88-93ce-488ca3d84f14', 'c1cb38f2-701c-4d48-a284-48ced375103f', 'ce07706f-bf4b-4c9e-9995-4263191d4d0e', 'f32577b2-ec41-4940-9cc5-ed1f24a10311'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:15 devstack sudo[106599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7
Jul 06 21:11:15 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:15 devstack sudo[106604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:15 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:15 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5" returned: 0 in 1.170s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:15 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a 1G
Jul 06 21:11:15 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (53390964-89f2-4630-babc-5cc698780742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a8ad40-29fe-4e4d-a5af-184832ed26f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a8ad40-29fe-4e4d-a5af-184832ed26f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001247618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe9265d-ac22-4063-8b9a-360239601563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:16Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cc2970-2a4a-4f07-a982-cbc73076f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64cc2970-2a4a-4f07-a982-cbc73076f805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5ce33d-4ff3-4f87-9732-574fc3b7125f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5ce33d-4ff3-4f87-9732-574fc3b7125f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fe9265d-ac22-4063-8b9a-360239601563', 'volume_name': 'volume-7fe9265d-ac22-4063-8b9a-360239601563', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f0eaeb-d83c-4cb1-8cd7-973487e06c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f0eaeb-d83c-4cb1-8cd7-973487e06c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccab0b64-58dd-4108-9c48-e67b48bf1ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:16 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Volume 7fe9265d-ac22-4063-8b9a-360239601563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fe9265d-ac22-4063-8b9a-360239601563', 'volume_size': 1}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:16 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.064s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:16 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" returned: 0 in 1.382s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9201a81-d87f-4d30-a914-ca7b209fb65b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:11:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Deleted volume successfully.
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef850a9f-89ea-45ad-b8be-d7615137edfb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-946f1536-0ff3-4ba9-a672-544b97e26bae tempest-VolumeDependencyTests-695248484 None] Lock "cinder-a182d7c6-9e36-4eae-9c27-63ae94a14372-delete_volume" released by "delete_volume" :: held 3.210s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:16 devstack sudo[106618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b
Jul 06 21:11:16 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:16 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a 1G" returned: 0 in 1.252s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820cc453-ffba-49f4-bc67-c31f41194dc5 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:16 devstack sudo[106620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820cc453-ffba-49f4-bc67-c31f41194dc5 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a
Jul 06 21:11:16 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:17 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b" returned: 0 in 0.903s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:17 devstack sudo[106628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7
Jul 06 21:11:17 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:17 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-820cc453-ffba-49f4-bc67-c31f41194dc5 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a" returned: 0 in 0.796s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:17 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a is being set with open permissions: ugo+rw
Jul 06 21:11:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:17 devstack sudo[106630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a
Jul 06 21:11:17 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:18 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a" returned: 0 in 0.678s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:18 devstack sudo[106638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.info
Jul 06 21:11:18 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:18 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" returned: 0 in 0.900s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:18 devstack sudo[106640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7
Jul 06 21:11:18 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:19 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.info" returned: 0 in 0.792s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:19 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.info is being set with open permissions: ugo+rw
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:19 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b.dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" returned: 0 in 0.758s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:19 devstack sudo[106644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.info
Jul 06 21:11:19 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-dab77c8c-3293-4dc1-8d86-2e9e4db5edb7" released by "_delete_snapshot" :: held 4.097s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e9201a81-d87f-4d30-a914-ca7b209fb65b" released by "delete_snapshot" :: held 4.135s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Created reservations ['fb303983-3de0-4b84-8796-189df06398ae', '97f5992f-ab57-4469-8c49-2c86e4a1072f', '89861a1a-9e20-44cd-9cef-2a2518255e1c', 'f80012c8-6942-4b5e-af40-57570b3ce142'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:19 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-95e2ab66-a1d0-4c9c-bfed-c4554a8d0b8e tempest-ProjectMemberTests-403782602 None] Lock "cinder-dab77c8c-3293-4dc1-8d86-2e9e4db5edb7-delete_snapshot" released by "delete_snapshot" :: held 4.341s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:19 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.info" returned: 0 in 0.716s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.556s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.530s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1001247618',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fe9265d-ac22-4063-8b9a-360239601563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:16Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Creating volume 7fe9265d-ac22-4063-8b9a-360239601563 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:19 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:19 devstack sudo[106648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563 1073741824
Jul 06 21:11:19 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:19 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-73faa153-1afe-4cbc-8ae2-a6cf70b14f9a tempest-ProjectReaderTests-1922464028 None] Create snapshot completed successfully
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-92b9886c-8286-4138-9e24-99d8e31063d3 tempest-ProjectAdminTests-142585744 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.75777053833, 'free_capacity_gb': 1775.75777053833, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86721) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-e9201a81-d87f-4d30-a914-ca7b209fb65b-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Lock "cinder-e9201a81-d87f-4d30-a914-ca7b209fb65b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-e9201a81-d87f-4d30-a914-ca7b209fb65b" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e9201a81-d87f-4d30-a914-ca7b209fb65b" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b66a11-13cb-46a2-b3ac-f5698e3f2997]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:20 devstack sudo[106653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b
Jul 06 21:11:20 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:20 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563 1073741824" returned: 0 in 0.977s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-94419f31-f3e9-4c3d-b3bc-81c24093294a-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:20 devstack sudo[106655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563
Jul 06 21:11:20 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-94419f31-f3e9-4c3d-b3bc-81c24093294a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-820cc453-ffba-49f4-bc67-c31f41194dc5" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-820cc453-ffba-49f4-bc67-c31f41194dc5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-94419f31-f3e9-4c3d-b3bc-81c24093294a" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-94419f31-f3e9-4c3d-b3bc-81c24093294a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:20 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Deleting offline snapshot 94419f31-f3e9-4c3d-b3bc-81c24093294a of volume 820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] snapshot_file for this snap is: volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[61629d8f-d47a-452d-b783-15d6038662a8]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:21 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a
Jul 06 21:11:21 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:21 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b" returned: 0 in 1.046s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:21 devstack sudo[106664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b
Jul 06 21:11:21 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:21 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563" returned: 0 in 0.830s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccab0b64-58dd-4108-9c48-e67b48bf1ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fe9265d-ac22-4063-8b9a-360239601563', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2be4077-1ac4-4b69-98bf-ff6ef86a8c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:21 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Volume volume-7fe9265d-ac22-4063-8b9a-360239601563 (7fe9265d-ac22-4063-8b9a-360239601563): created successfully
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2be4077-1ac4-4b69-98bf-ff6ef86a8c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:21 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (53390964-89f2-4630-babc-5cc698780742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:21 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9ebe17e9-5075-4fbf-b3d6-d6c7a477f899 tempest-ProjectReaderTests-1997393306 None] Created volume successfully.
Jul 06 21:11:22 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a" returned: 0 in 0.993s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-820cc453-ffba-49f4-bc67-c31f41194dc5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a00e3565-03bb-4132-a047-c45cce89ee11]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:22 devstack sudo[106669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5
Jul 06 21:11:22 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:22 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e9201a81-d87f-4d30-a914-ca7b209fb65b" returned: 0 in 0.836s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e9201a81-d87f-4d30-a914-ca7b209fb65b" released by "delete_volume" :: held 1.966s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Created reservations ['613d99ed-4fbc-4419-8efb-32211d859a3b', 'df61e7ea-7676-43f9-95c1-9741d077a1b1', '18347cdb-bade-4c34-968b-b2b78d7e411a', '84d97eeb-605f-45e5-bbae-a65653e829f1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:22 devstack sudo[106679]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:22 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-7fe9265d-ac22-4063-8b9a-360239601563-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-7fe9265d-ac22-4063-8b9a-360239601563-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-quobyte-7fe9265d-ac22-4063-8b9a-360239601563" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-7fe9265d-ac22-4063-8b9a-360239601563" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:23 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[093c60bd-197c-4f19-960f-d588f354fc3c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5" returned: 0 in 1.209s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:23 devstack sudo[106686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a
Jul 06 21:11:23 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:23 devstack sudo[106685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563
Jul 06 21:11:23 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:23 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.862s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-e5abda37-a16a-486f-97a7-cee9bab51ace tempest-ProjectMemberTests-403782602 None] Lock "cinder-e9201a81-d87f-4d30-a914-ca7b209fb65b-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (8a9d597d-2b3b-4005-ba27-bf84a19a6dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a866ecf5-fc1f-4056-9299-b0ce961e7e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a866ecf5-fc1f-4056-9299-b0ce961e7e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025017357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2960d74-9d9e-4137-8f4b-f8fb9446906c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:24Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0893e3a1-11be-47c3-aef9-19192a6e7f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0893e3a1-11be-47c3-aef9-19192a6e7f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ff7cc9-56c2-42ff-9653-cacba2490b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ff7cc9-56c2-42ff-9653-cacba2490b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2960d74-9d9e-4137-8f4b-f8fb9446906c', 'volume_name': 'volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5c0876-f258-44c2-96c3-244ff2360de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc5c0876-f258-44c2-96c3-244ff2360de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b450ac7-c10c-4a9d-a2fa-f7c692257261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Volume d2960d74-9d9e-4137-8f4b-f8fb9446906c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c', 'volume_size': 1}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1025017357',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2960d74-9d9e-4137-8f4b-f8fb9446906c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:24Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Creating volume d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:23 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:23 devstack sudo[106690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c 1073741824
Jul 06 21:11:23 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:24 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563" returned: 0 in 1.024s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:24 devstack sudo[106698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563
Jul 06 21:11:24 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:24 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a" returned: 0 in 1.094s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:24 devstack sudo[106700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a
Jul 06 21:11:24 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:24 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c 1073741824" returned: 0 in 1.116s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:24 devstack sudo[106706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c
Jul 06 21:11:24 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:25 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7fe9265d-ac22-4063-8b9a-360239601563" returned: 0 in 0.841s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-7fe9265d-ac22-4063-8b9a-360239601563" released by "delete_volume" :: held 1.945s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Created reservations ['0721e9c1-914f-4705-9019-05e555b9b2e4', '8bde7415-5389-4d81-b222-f2799d583a5d', '12a9746a-217e-4bdf-8643-d397cd4c1051', '4994b006-6f87-40b2-9f8a-6bfaf97198f0'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:25 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5.94419f31-f3e9-4c3d-b3bc-81c24093294a" returned: 0 in 0.870s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-94419f31-f3e9-4c3d-b3bc-81c24093294a" released by "_delete_snapshot" :: held 4.283s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-820cc453-ffba-49f4-bc67-c31f41194dc5" released by "delete_snapshot" :: held 4.318s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:25 devstack sudo[106710]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:25 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Created reservations ['f7b7a85d-ce94-4b31-b8c2-28650b782632', '540e6dfc-c4ff-440b-9c41-daf5224b249b', '2392f1ce-5cfa-4fe7-a356-125393421b30', 'eac14e15-d1cf-43f1-bda1-ed5650e66ae1'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Delete snapshot completed successfully.
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d574ea-0b13-43d2-b9f6-b7330e7ad6d1 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-94419f31-f3e9-4c3d-b3bc-81c24093294a-delete_snapshot" released by "delete_snapshot" :: held 4.622s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:25 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c" returned: 0 in 0.860s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b450ac7-c10c-4a9d-a2fa-f7c692257261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d77936e-f67a-4919-be05-612f608bc582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Volume volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c (d2960d74-9d9e-4137-8f4b-f8fb9446906c): created successfully
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d77936e-f67a-4919-be05-612f608bc582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (8a9d597d-2b3b-4005-ba27-bf84a19a6dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d4e1f4c5-bfb5-422f-9e0f-0c3dc5d8d3a6 tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (0894c528-a29f-448f-bb71-5ed0b98084c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a38550c-1a5d-46a6-8ad9-d5c3d10dcc65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a38550c-1a5d-46a6-8ad9-d5c3d10dcc65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613481986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14041014-ddbf-45a1-9777-31386aee79fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:26Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c65cea-178e-4727-84e2-086f7aea5d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c65cea-178e-4727-84e2-086f7aea5d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7136374-7180-4e13-aa30-5152dfddc07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7136374-7180-4e13-aa30-5152dfddc07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14041014-ddbf-45a1-9777-31386aee79fe', 'volume_name': 'volume-14041014-ddbf-45a1-9777-31386aee79fe', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6feb8ec-a5dc-47ad-be87-cfe3e377c72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6feb8ec-a5dc-47ad-be87-cfe3e377c72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669461fe-dc05-4f7b-b492-67804e456b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:26 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Volume 14041014-ddbf-45a1-9777-31386aee79fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14041014-ddbf-45a1-9777-31386aee79fe', 'volume_size': 1}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613481986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14041014-ddbf-45a1-9777-31386aee79fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:26Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Creating volume 14041014-ddbf-45a1-9777-31386aee79fe {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:26 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:26 devstack sudo[106714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe 1073741824
Jul 06 21:11:26 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:26 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.923s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:26 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Deleted volume successfully.
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4890c63e-1478-46a7-bda4-49c4701c5c85 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-7fe9265d-ac22-4063-8b9a-360239601563-delete_volume" released by "delete_volume" :: held 3.214s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-820cc453-ffba-49f4-bc67-c31f41194dc5-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-820cc453-ffba-49f4-bc67-c31f41194dc5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-820cc453-ffba-49f4-bc67-c31f41194dc5" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-820cc453-ffba-49f4-bc67-c31f41194dc5" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebcedd8-37a6-42a4-9a00-ef355b475611]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:26 devstack sudo[106716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5
Jul 06 21:11:26 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:27 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe 1073741824" returned: 0 in 1.029s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:27 devstack sudo[106723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe
Jul 06 21:11:27 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:27 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5" returned: 0 in 0.930s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:27 devstack sudo[106728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5
Jul 06 21:11:27 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:27 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe" returned: 0 in 0.766s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] <== create_volume: return (1838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.842s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.848s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (669461fe-dc05-4f7b-b492-67804e456b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14041014-ddbf-45a1-9777-31386aee79fe', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8277ad0-9d4b-462b-b064-7d193f67b499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Creating offline snapshot b8c47a46-2f70-4f14-af66-87beddf58430 of volume d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:11:28 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Volume volume-14041014-ddbf-45a1-9777-31386aee79fe (14041014-ddbf-45a1-9777-31386aee79fe): created successfully
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8277ad0-9d4b-462b-b064-7d193f67b499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (0894c528-a29f-448f-bb71-5ed0b98084c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[509df69a-53e7-433f-9f0c-c018bfc82d49]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:28 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d75599a9-9c9e-45cf-9a0e-15515fdad8a4 tempest-ProjectReaderTests-1997393306 None] Created volume successfully.
Jul 06 21:11:28 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-820cc453-ffba-49f4-bc67-c31f41194dc5" returned: 0 in 0.787s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-820cc453-ffba-49f4-bc67-c31f41194dc5" released by "delete_volume" :: held 1.779s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:28 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c
Jul 06 21:11:28 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Created reservations ['83fb5690-5254-4863-92a1-46f029e7b5bb', '6b497abc-96ad-4fe2-9c76-befb848c2758', 'cb3173c0-3d66-415c-ae95-c0fb39c16cff', 'bfb626e6-5b1f-43b9-91f4-98872cdf7545'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-14041014-ddbf-45a1-9777-31386aee79fe-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-14041014-ddbf-45a1-9777-31386aee79fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-quobyte-14041014-ddbf-45a1-9777-31386aee79fe" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-14041014-ddbf-45a1-9777-31386aee79fe" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c40efeb-ffcd-415d-979d-57a81505359d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:28 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:28 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:28 devstack sudo[106736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe
Jul 06 21:11:28 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:29 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c" returned: 0 in 1.032s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:29 devstack sudo[106743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 1G
Jul 06 21:11:29 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:29 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.931s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (c04f64ba-d52c-40a9-975d-0682c3394f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f382cd-acb9-4f4e-9054-3a3d77d7f417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:29 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:29 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Deleted volume successfully.
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe" returned: 0 in 0.992s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:29 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe
Jul 06 21:11:29 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0f382cd-acb9-4f4e-9054-3a3d77d7f417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593289994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c308766-c3f7-463c-9b64-92a2a15543e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:29Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27d4c11-916b-486e-8f28-e99e74fd242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f27d4c11-916b-486e-8f28-e99e74fd242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a9eac6-5f84-4ebf-b95f-37afa9a37664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1a9eac6-5f84-4ebf-b95f-37afa9a37664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c308766-c3f7-463c-9b64-92a2a15543e4', 'volume_name': 'volume-9c308766-c3f7-463c-9b64-92a2a15543e4', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e435867-1ff4-403e-8dc1-18a481b59e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e435867-1ff4-403e-8dc1-18a481b59e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce52181-70cf-45a4-b6d7-74285df73d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:29 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Volume 9c308766-c3f7-463c-9b64-92a2a15543e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c308766-c3f7-463c-9b64-92a2a15543e4', 'volume_size': 1}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5a91a15d-6ee0-4080-a1f8-b55be0216318 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-820cc453-ffba-49f4-bc67-c31f41194dc5-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:30 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 1G" returned: 0 in 0.962s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:30 devstack sudo[106755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430
Jul 06 21:11:30 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:30 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-14041014-ddbf-45a1-9777-31386aee79fe" returned: 0 in 0.802s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-14041014-ddbf-45a1-9777-31386aee79fe" released by "delete_volume" :: held 1.850s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Created reservations ['dc6dbbf4-78ca-4639-8e29-78e6e3a7b9e5', '178787ac-de35-4e13-8037-6ed077317356', '9ff7dc30-828a-4e78-8891-0e88f82f4463', '4704396f-50a3-433d-9f5d-8f26cd9529d3'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:30 devstack sudo[106757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:30 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:30 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430" returned: 0 in 0.897s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:30 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 is being set with open permissions: ugo+rw
Jul 06 21:11:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:31 devstack sudo[106764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430
Jul 06 21:11:31 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:31 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.731s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (632ad61f-6f58-456c-b4b4-b7d2f56ec054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d757e2-49ce-41f1-8006-b3a4a4372a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:31 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Deleted volume successfully.
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32d757e2-49ce-41f1-8006-b3a4a4372a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788055339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1b62ef-f98c-4de0-bdf1-982d67ad1341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:31Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436e0775-c92d-42b2-aa3a-9da7a85082d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (436e0775-c92d-42b2-aa3a-9da7a85082d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89c6c5f-8228-42bf-a946-d8e67962e49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b89c6c5f-8228-42bf-a946-d8e67962e49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1b62ef-f98c-4de0-bdf1-982d67ad1341', 'volume_name': 'volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a0d756-e4b9-472e-a15d-a8e30ca7e43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1a0d756-e4b9-472e-a15d-a8e30ca7e43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13943b72-05ed-4f63-882c-b2ff8c62abc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:31 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Volume 9e1b62ef-f98c-4de0-bdf1-982d67ad1341: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341', 'volume_size': 1}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-fb657145-ad0b-4e92-9f03-589928a445d5 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-14041014-ddbf-45a1-9777-31386aee79fe-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:31 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430" returned: 0 in 0.735s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:31 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.info
Jul 06 21:11:31 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:32 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.info" returned: 0 in 0.727s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:32 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.info is being set with open permissions: ugo+rw
Jul 06 21:11:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:32 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.info
Jul 06 21:11:32 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:33 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.info" returned: 0 in 0.762s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.249s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.738s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-593289994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c308766-c3f7-463c-9b64-92a2a15543e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:29Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Creating volume 9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:33 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:33 devstack sudo[106773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 1073741824
Jul 06 21:11:33 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:33 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c49beb25-379b-47e8-ad2f-6338e2dcbe9f tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-b8c47a46-2f70-4f14-af66-87beddf58430-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Lock "cinder-b8c47a46-2f70-4f14-af66-87beddf58430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-d2960d74-9d9e-4137-8f4b-f8fb9446906c" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-d2960d74-9d9e-4137-8f4b-f8fb9446906c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-b8c47a46-2f70-4f14-af66-87beddf58430" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-b8c47a46-2f70-4f14-af66-87beddf58430" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot b8c47a46-2f70-4f14-af66-87beddf58430 of volume d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed93314b-a9ea-4ef6-872f-cc6a73b01e5b]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:33 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430
Jul 06 21:11:33 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:34 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 1073741824" returned: 0 in 0.909s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:34 devstack sudo[106781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4
Jul 06 21:11:34 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:34 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430" returned: 0 in 0.890s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c470c9-5cf2-49bd-895e-f92d20f5b65d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:34 devstack sudo[106786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c
Jul 06 21:11:34 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:34 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4" returned: 0 in 0.775s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] <== create_volume: return (1738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.765s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-788055339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1b62ef-f98c-4de0-bdf1-982d67ad1341,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:31Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Creating volume 9e1b62ef-f98c-4de0-bdf1-982d67ad1341 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:35 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:35 devstack sudo[106789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341 1073741824
Jul 06 21:11:35 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bce52181-70cf-45a4-b6d7-74285df73d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c308766-c3f7-463c-9b64-92a2a15543e4', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f97d36-f729-46ca-b5f6-9937dff538f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:35 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Volume volume-9c308766-c3f7-463c-9b64-92a2a15543e4 (9c308766-c3f7-463c-9b64-92a2a15543e4): created successfully
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f97d36-f729-46ca-b5f6-9937dff538f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (c04f64ba-d52c-40a9-975d-0682c3394f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:35 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-640931ee-9af4-48bb-8d14-5e523cd64ca7 tempest-ProjectReaderTests-1922464028 None] Created volume successfully.
Jul 06 21:11:35 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c" returned: 0 in 0.843s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:35 devstack sudo[106794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430
Jul 06 21:11:35 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:INSERT=42,cinder:UPDATE=180,cinder:SELECT=145,cinder:DELETE=18 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Flow 'volume_create_manager' (7068218c-b123-4b65-b8da-8829de9ff0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44d82dc-ca56-4436-990f-08ee72838f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f44d82dc-ca56-4436-990f-08ee72838f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25802533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1063de-7730-4a84-aaf2-0f9ea5052558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e992df91d603479c9d48e93cecc9fa58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:36Z,use_quota=True,user_id='1834d9af2d0d4b5b8784e0250d7be889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447e1815-e9d7-49f7-ad0f-b67c7a3dacc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447e1815-e9d7-49f7-ad0f-b67c7a3dacc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d5c8e9-5ee3-4dc1-a311-6fd69ed3e956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8d5c8e9-5ee3-4dc1-a311-6fd69ed3e956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da1063de-7730-4a84-aaf2-0f9ea5052558', 'volume_name': 'volume-da1063de-7730-4a84-aaf2-0f9ea5052558', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1652d31-6d09-4acf-b190-eb3991d294f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1652d31-6d09-4acf-b190-eb3991d294f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e2884-176b-47e0-9302-0711833afe75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:35 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Volume da1063de-7730-4a84-aaf2-0f9ea5052558: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da1063de-7730-4a84-aaf2-0f9ea5052558', 'volume_size': 1}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:36 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341 1073741824" returned: 0 in 1.010s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:36 devstack sudo[106799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341
Jul 06 21:11:36 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:36 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430" returned: 0 in 0.888s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:36 devstack sudo[106804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430
Jul 06 21:11:36 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:36 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341" returned: 0 in 0.691s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.793s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-25802533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da1063de-7730-4a84-aaf2-0f9ea5052558,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e992df91d603479c9d48e93cecc9fa58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:36Z,use_quota=True,user_id='1834d9af2d0d4b5b8784e0250d7be889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Creating volume da1063de-7730-4a84-aaf2-0f9ea5052558 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:36 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:36 devstack sudo[106807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558 1073741824
Jul 06 21:11:36 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13943b72-05ed-4f63-882c-b2ff8c62abc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07949f6f-84c6-4c42-bc79-0e0bee98aa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:DELETE=12,cinder:UPDATE=190,cinder:SELECT=135,cinder:INSERT=55 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:11:36 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Volume volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341 (9e1b62ef-f98c-4de0-bdf1-982d67ad1341): created successfully
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07949f6f-84c6-4c42-bc79-0e0bee98aa00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:36 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (632ad61f-6f58-456c-b4b4-b7d2f56ec054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:36 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-dc0bdd3b-f0d9-4b75-88dd-f8f7e94d8295 tempest-ProjectReaderTests-1997393306 None] Created volume successfully.
Jul 06 21:11:36 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c.b8c47a46-2f70-4f14-af66-87beddf58430" returned: 0 in 0.718s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-b8c47a46-2f70-4f14-af66-87beddf58430" released by "_delete_snapshot" :: held 3.461s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-d2960d74-9d9e-4137-8f4b-f8fb9446906c" released by "delete_snapshot" :: held 3.494s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Created reservations ['c56f7cad-410f-43e0-a8c5-e3c322418349', '6f187438-3e42-4cb4-9bc0-fc72fcbe389c', 'd8b2bf04-2e06-46a6-8a6c-3b9816a3baba', '4d47caff-e405-489e-9b12-dc3571e6516b'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-df25e43f-89e2-41b0-8bd9-68e942a93fe5 tempest-ProjectMemberTests-403782602 None] Lock "cinder-b8c47a46-2f70-4f14-af66-87beddf58430-delete_snapshot" released by "delete_snapshot" :: held 3.646s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:37 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-9e1b62ef-f98c-4de0-bdf1-982d67ad1341-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558 1073741824" returned: 0 in 0.904s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:37 devstack sudo[106814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:37 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-9e1b62ef-f98c-4de0-bdf1-982d67ad1341-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-quobyte-9e1b62ef-f98c-4de0-bdf1-982d67ad1341" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:37 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558
Jul 06 21:11:37 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-9e1b62ef-f98c-4de0-bdf1-982d67ad1341" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-d2960d74-9d9e-4137-8f4b-f8fb9446906c-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cda9b64-447c-4a69-8e72-6532138328dc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Lock "cinder-d2960d74-9d9e-4137-8f4b-f8fb9446906c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-d2960d74-9d9e-4137-8f4b-f8fb9446906c" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-d2960d74-9d9e-4137-8f4b-f8fb9446906c" acquired by "delete_volume" :: waited 0.034s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:38 devstack sudo[106818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341
Jul 06 21:11:38 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7605742-69e9-46ef-99ce-9c9b41153834]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:38 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c
Jul 06 21:11:38 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:38 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.746s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:11:38 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558" returned: 0 in 0.856s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.608s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Creating offline snapshot 409aca00-a145-4247-aefe-f9a14e54e18f of volume 9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa3e2884-176b-47e0-9302-0711833afe75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da1063de-7730-4a84-aaf2-0f9ea5052558', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9a32c-2eee-4ea8-b628-67dbef5eb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5c64da-766b-4812-ab47-5cc13ecae6a4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:38 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Volume volume-da1063de-7730-4a84-aaf2-0f9ea5052558 (da1063de-7730-4a84-aaf2-0f9ea5052558): created successfully
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f9a32c-2eee-4ea8-b628-67dbef5eb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Flow 'volume_create_manager' (7068218c-b123-4b65-b8da-8829de9ff0fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:38 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c0ec5516-7c08-443f-a9cb-fbafab167c06 tempest-ProjectReaderTests-535855104 None] Created volume successfully.
Jul 06 21:11:38 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341" returned: 0 in 0.872s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:38 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4
Jul 06 21:11:38 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:38 devstack sudo[106830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341
Jul 06 21:11:38 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:38 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c" returned: 0 in 0.932s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:39 devstack sudo[106836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c
Jul 06 21:11:39 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Acquiring lock "cinder-da1063de-7730-4a84-aaf2-0f9ea5052558-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Lock "cinder-da1063de-7730-4a84-aaf2-0f9ea5052558-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Acquiring lock "cinder-quobyte-da1063de-7730-4a84-aaf2-0f9ea5052558" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Lock "cinder-quobyte-da1063de-7730-4a84-aaf2-0f9ea5052558" acquired by "delete_volume" :: waited 0.033s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[24197eab-af3c-4a7b-83fc-3a8fd8bcf3c7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:39 devstack sudo[106838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558
Jul 06 21:11:39 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:39 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9e1b62ef-f98c-4de0-bdf1-982d67ad1341" returned: 0 in 0.810s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-9e1b62ef-f98c-4de0-bdf1-982d67ad1341" released by "delete_volume" :: held 1.768s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:39 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4" returned: 0 in 0.940s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:39 devstack sudo[106844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f 1G
Jul 06 21:11:39 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Created reservations ['a3f273c0-ffbf-48b1-ae2b-3cb9a320db72', '42a53dea-dceb-401b-8bd6-de6fc370cf04', '095291d9-f8d8-4d6b-bb00-5b9f58fd564f', 'e978ecfd-61ed-4d76-946a-9cb42929920d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:39 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:39 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:39 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-d2960d74-9d9e-4137-8f4b-f8fb9446906c" returned: 0 in 0.809s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-d2960d74-9d9e-4137-8f4b-f8fb9446906c" released by "delete_volume" :: held 1.818s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:39 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Created reservations ['bf4c61e5-5445-4807-bc68-63ed9cb7d3c6', '6c90e657-6eb0-490c-90bb-5eeb17c8e755', '49c9b9b9-dde1-4647-9706-667217011980', '294fa644-64e3-4cd5-af3d-52fe60823725'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:40 devstack sudo[106849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:40 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:40 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558" returned: 0 in 1.328s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:40 devstack sudo[106858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558
Jul 06 21:11:40 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (d183e51e-7f1d-4608-8cb7-88a15443c280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:40 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6632778e-84a7-4040-a928-f9cf3eed7a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.148s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:40 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f 1G" returned: 0 in 1.325s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c308766-c3f7-463c-9b64-92a2a15543e4 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:40 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6632778e-84a7-4040-a928-f9cf3eed7a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71240371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0114ff27-c1ca-418a-94a7-ec7dce0c7544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:41Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d15bab-aee0-49f8-b177-afe7d6ee15af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:40 devstack sudo[106863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c308766-c3f7-463c-9b64-92a2a15543e4 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f
Jul 06 21:11:40 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d15bab-aee0-49f8-b177-afe7d6ee15af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b4ab0f-ce7c-4d85-bf85-757dcf34ade8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:40 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66b4ab0f-ce7c-4d85-bf85-757dcf34ade8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0114ff27-c1ca-418a-94a7-ec7dce0c7544', 'volume_name': 'volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b4d06d-a41c-4c5a-99d1-09694459ef91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2b4d06d-a41c-4c5a-99d1-09694459ef91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72633a89-d3f2-4716-a4dd-20273c45c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Volume 0114ff27-c1ca-418a-94a7-ec7dce0c7544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544', 'volume_size': 1}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Deleted volume successfully.
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 1.030s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:41 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-1eeb1772-e521-4034-b44e-37b93e98a788 tempest-ProjectReaderTests-1997393306 None] Lock "cinder-9e1b62ef-f98c-4de0-bdf1-982d67ad1341-delete_volume" released by "delete_volume" :: held 3.389s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f8b1c9c8-c823-4c11-a72d-d5f4e9001304 tempest-ProjectMemberTests-403782602 None] Lock "cinder-d2960d74-9d9e-4137-8f4b-f8fb9446906c-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (658c5a0e-10a9-46ba-99d9-9de1a128efca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898f2f2f-6aba-4f23-af0d-b412879417c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (898f2f2f-6aba-4f23-af0d-b412879417c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354454208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7fe6f2-2726-4fff-940e-78524e648077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:41Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eeddacd-47e1-40f4-801a-426ed2374911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2eeddacd-47e1-40f4-801a-426ed2374911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bb7f46-b91b-4b13-af37-015b6a070937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bb7f46-b91b-4b13-af37-015b6a070937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b7fe6f2-2726-4fff-940e-78524e648077', 'volume_name': 'volume-1b7fe6f2-2726-4fff-940e-78524e648077', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6703246-2578-487d-8cb7-70d08d72eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6703246-2578-487d-8cb7-70d08d72eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751c69fd-5df7-4525-8975-b7b9647f672a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:41 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Volume 1b7fe6f2-2726-4fff-940e-78524e648077: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b7fe6f2-2726-4fff-940e-78524e648077', 'volume_size': 1}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:41 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-da1063de-7730-4a84-aaf2-0f9ea5052558" returned: 0 in 0.803s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Lock "cinder-quobyte-da1063de-7730-4a84-aaf2-0f9ea5052558" released by "delete_volume" :: held 2.183s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Created reservations ['2be59969-0d3c-4aa5-855b-aa9e93ac126c', '00e1ab8f-4c5d-4cd9-b3c8-cbba22d3c30d', 'ba6af781-bda7-480e-9fcb-c118f4eacb75', '3c214177-84d0-4672-9a51-1c297f50512e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:41 devstack sudo[106872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:41 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:41 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c308766-c3f7-463c-9b64-92a2a15543e4 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f" returned: 0 in 0.840s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:41 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f is being set with open permissions: ugo+rw
Jul 06 21:11:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:41 devstack sudo[106874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f
Jul 06 21:11:41 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:42 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.698s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:42 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:42 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Deleted volume successfully.
Jul 06 21:11:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1cc2e3a-1515-4eeb-858e-55b6110c3999 tempest-ProjectReaderTests-535855104 None] Lock "cinder-da1063de-7730-4a84-aaf2-0f9ea5052558-delete_volume" released by "delete_volume" :: held 3.140s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:42 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f" returned: 0 in 0.714s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:42 devstack sudo[106879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.info
Jul 06 21:11:42 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Flow 'volume_create_manager' (6cde8e8d-5ac4-4bbc-ac0f-9acb0c34b9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84685999-cc7c-4190-b4f3-3121c2c9c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84685999-cc7c-4190-b4f3-3121c2c9c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408926599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29b0339-d26a-4447-9533-1358cb4dd50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e992df91d603479c9d48e93cecc9fa58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:43Z,use_quota=True,user_id='1834d9af2d0d4b5b8784e0250d7be889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30274a43-d796-48ed-b407-bb4e3d3b3d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30274a43-d796-48ed-b407-bb4e3d3b3d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e16627-71c6-4afe-ad30-501661104853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96e16627-71c6-4afe-ad30-501661104853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f29b0339-d26a-4447-9533-1358cb4dd50d', 'volume_name': 'volume-f29b0339-d26a-4447-9533-1358cb4dd50d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6507c-6ac9-4772-8b33-f96b67470e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f6507c-6ac9-4772-8b33-f96b67470e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2251f0a9-5201-483f-9af4-3ea13fcd2763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:43 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Volume f29b0339-d26a-4447-9533-1358cb4dd50d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f29b0339-d26a-4447-9533-1358cb4dd50d', 'volume_size': 1}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:43 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.info" returned: 0 in 0.700s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:43 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.info is being set with open permissions: ugo+rw
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:43 devstack sudo[106882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.info
Jul 06 21:11:43 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:43 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.info" returned: 0 in 0.735s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.345s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.905s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-71240371',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0114ff27-c1ca-418a-94a7-ec7dce0c7544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4697685fd04bc0a04979c1d1507c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:41Z,use_quota=True,user_id='8d9fc5549bc747c588ef85977954b56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Creating volume 0114ff27-c1ca-418a-94a7-ec7dce0c7544 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:43 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:43 devstack sudo[106885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544 1073741824
Jul 06 21:11:43 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:43 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-966a2d07-f96f-4ac2-8f0f-ea13ac7af629 tempest-ProjectReaderTests-1922464028 None] Create snapshot completed successfully
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-409aca00-a145-4247-aefe-f9a14e54e18f-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Lock "cinder-409aca00-a145-4247-aefe-f9a14e54e18f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-9c308766-c3f7-463c-9b64-92a2a15543e4" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9c308766-c3f7-463c-9b64-92a2a15543e4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-409aca00-a145-4247-aefe-f9a14e54e18f" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-409aca00-a145-4247-aefe-f9a14e54e18f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Deleting offline snapshot 409aca00-a145-4247-aefe-f9a14e54e18f of volume 9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] snapshot_file for this snap is: volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41859d3-99de-4af2-bfb1-8c7b875cf4b4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:44 devstack sudo[106887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f
Jul 06 21:11:44 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:44 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544 1073741824" returned: 0 in 0.892s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:44 devstack sudo[106892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544
Jul 06 21:11:44 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:45 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f" returned: 0 in 0.849s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c308766-c3f7-463c-9b64-92a2a15543e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0308d711-322d-4a10-a08b-efe7fd0323c9]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:45 devstack sudo[106897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4
Jul 06 21:11:45 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:45 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544" returned: 0 in 0.665s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.606s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.289s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-354454208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b7fe6f2-2726-4fff-940e-78524e648077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:41Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Creating volume 1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:45 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:45 devstack sudo[106900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 1073741824
Jul 06 21:11:45 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72633a89-d3f2-4716-a4dd-20273c45c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baa8e03-3522-4d2a-9865-7eead37a1a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Volume volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544 (0114ff27-c1ca-418a-94a7-ec7dce0c7544): created successfully
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baa8e03-3522-4d2a-9865-7eead37a1a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Flow 'volume_create_manager' (d183e51e-7f1d-4608-8cb7-88a15443c280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-60f3cfeb-168f-4f54-b3b8-bbc6a48b7b46 tempest-ProjectReaderTests-1997393306 None] Created volume successfully.
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-0114ff27-c1ca-418a-94a7-ec7dce0c7544-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Lock "cinder-0114ff27-c1ca-418a-94a7-ec7dce0c7544-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Acquiring lock "cinder-quobyte-0114ff27-c1ca-418a-94a7-ec7dce0c7544" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-0114ff27-c1ca-418a-94a7-ec7dce0c7544" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c927e28-6e53-4149-8b69-b099cdd2c17c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:46 devstack sudo[106902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544
Jul 06 21:11:46 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:46 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4" returned: 0 in 0.896s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:46 devstack sudo[106910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f
Jul 06 21:11:46 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:46 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 1073741824" returned: 0 in 0.924s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:46 devstack sudo[106912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077
Jul 06 21:11:46 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:46 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544" returned: 0 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:46 devstack sudo[106920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544
Jul 06 21:11:46 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:47 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:47 devstack sudo[106924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f
Jul 06 21:11:47 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:47 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077" returned: 0 in 0.684s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.091s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-408926599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f29b0339-d26a-4447-9533-1358cb4dd50d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e992df91d603479c9d48e93cecc9fa58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:43Z,use_quota=True,user_id='1834d9af2d0d4b5b8784e0250d7be889',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Creating volume f29b0339-d26a-4447-9533-1358cb4dd50d {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:47 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751c69fd-5df7-4525-8975-b7b9647f672a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b7fe6f2-2726-4fff-940e-78524e648077', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:47 devstack sudo[106926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d 1073741824
Jul 06 21:11:47 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba93e672-320f-4a50-96b1-85d1e2337c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:47 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Volume volume-1b7fe6f2-2726-4fff-940e-78524e648077 (1b7fe6f2-2726-4fff-940e-78524e648077): created successfully
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba93e672-320f-4a50-96b1-85d1e2337c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (658c5a0e-10a9-46ba-99d9-9de1a128efca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ef7f8856-eda8-483b-8f88-b50eed6c327a tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:11:47 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-0114ff27-c1ca-418a-94a7-ec7dce0c7544" returned: 0 in 0.706s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Lock "cinder-quobyte-0114ff27-c1ca-418a-94a7-ec7dce0c7544" released by "delete_volume" :: held 1.612s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Created reservations ['f99c1705-4bb9-4972-8288-439eeadda61e', 'a1a16f83-48d3-478b-a549-232fac2a5d37', 'b71ece27-25b6-4844-ab8b-2a6e7021bcb4', '3de701c2-6d75-4196-8473-7ebc60b15365'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:47 devstack sudo[106930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:47 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:47 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4.409aca00-a145-4247-aefe-f9a14e54e18f" returned: 0 in 0.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-409aca00-a145-4247-aefe-f9a14e54e18f" released by "_delete_snapshot" :: held 3.490s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:47 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9c308766-c3f7-463c-9b64-92a2a15543e4" released by "delete_snapshot" :: held 3.515s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Created reservations ['00db6585-3c09-467b-8cb7-fe039a191612', 'b68cc3fd-1667-41e7-a2af-dfb01c05fd4f', '92af095b-0185-4124-b21b-32be4f4be22d', 'f0e99c83-3778-48d2-b791-e44ddd401f95'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Delete snapshot completed successfully.
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-c5fe600c-6869-490c-9816-8df4c4a9264d tempest-ProjectReaderTests-1922464028 None] Lock "cinder-409aca00-a145-4247-aefe-f9a14e54e18f-delete_snapshot" released by "delete_snapshot" :: held 3.684s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:48 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d 1073741824" returned: 0 in 1.057s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:48 devstack sudo[106938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d
Jul 06 21:11:48 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:48 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.759s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:48 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Deleted volume successfully.
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-4c68aefd-bd3f-48d8-84fe-108dcca4d6ff tempest-ProjectReaderTests-1997393306 None] Lock "cinder-0114ff27-c1ca-418a-94a7-ec7dce0c7544-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-9c308766-c3f7-463c-9b64-92a2a15543e4-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-9c308766-c3f7-463c-9b64-92a2a15543e4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-9c308766-c3f7-463c-9b64-92a2a15543e4" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9c308766-c3f7-463c-9b64-92a2a15543e4" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b909f94c-243b-47d4-a0de-70ddd7fc7eb5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:48 devstack sudo[106941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4
Jul 06 21:11:48 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:49 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.299s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2251f0a9-5201-483f-9af4-3ea13fcd2763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f29b0339-d26a-4447-9533-1358cb4dd50d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712aceb3-b957-491b-b94b-0e1357b2b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Creating offline snapshot 2557addf-6302-435a-a6de-f9571140d37b of volume 1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:11:49 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Volume volume-f29b0339-d26a-4447-9533-1358cb4dd50d (f29b0339-d26a-4447-9533-1358cb4dd50d): created successfully
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712aceb3-b957-491b-b94b-0e1357b2b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Flow 'volume_create_manager' (6cde8e8d-5ac4-4bbc-ac0f-9acb0c34b9f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fe3b86-423d-4a9f-806f-77909880a277]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:49 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6f0abffd-8e9b-4888-92df-8fa169f1d360 tempest-ProjectReaderTests-535855104 None] Created volume successfully.
Jul 06 21:11:49 devstack sudo[106944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077
Jul 06 21:11:49 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Acquiring lock "cinder-f29b0339-d26a-4447-9533-1358cb4dd50d-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Lock "cinder-f29b0339-d26a-4447-9533-1358cb4dd50d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Acquiring lock "cinder-quobyte-f29b0339-d26a-4447-9533-1358cb4dd50d" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Lock "cinder-quobyte-f29b0339-d26a-4447-9533-1358cb4dd50d" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a348bfb2-f35a-4a33-8eb5-1d800fae8724]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:49 devstack sudo[106949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d
Jul 06 21:11:49 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:49 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4" returned: 0 in 1.009s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:49 devstack sudo[106951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4
Jul 06 21:11:49 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:50 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077" returned: 0 in 1.103s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:50 devstack sudo[106956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b 1G
Jul 06 21:11:50 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:50 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d" returned: 0 in 0.974s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:50 devstack sudo[106963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d
Jul 06 21:11:50 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:50 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9c308766-c3f7-463c-9b64-92a2a15543e4" returned: 0 in 0.853s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9c308766-c3f7-463c-9b64-92a2a15543e4" released by "delete_volume" :: held 1.941s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Created reservations ['79032d73-0e3e-433a-8a0e-66e8d203dcfa', 'ee29e32e-9371-45b2-94e2-4d144bb6ea93', 'bbf39edb-125c-42da-9a31-0d12c00c3ff4', 'ade9206d-3b47-44b6-92dd-683aea7b5d4b'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:50 devstack sudo[106965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:50 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:51 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b 1G" returned: 0 in 0.994s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7fe6f2-2726-4fff-940e-78524e648077 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:51 devstack sudo[106972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7fe6f2-2726-4fff-940e-78524e648077 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b
Jul 06 21:11:51 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:51 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-f29b0339-d26a-4447-9533-1358cb4dd50d" returned: 0 in 0.831s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Lock "cinder-quobyte-f29b0339-d26a-4447-9533-1358cb4dd50d" released by "delete_volume" :: held 1.860s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Created reservations ['df0038e1-d81a-4055-9b31-f5f5ddc7ab4c', '7caf1b8f-2aaf-42ad-9221-be91c06028a3', 'e58dc5c6-a9d1-452e-8ed3-4dca487a762d', '696f439b-4979-4187-b717-97abf59dbc02'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (09a43daa-007d-42e2-9841-03ecc40515dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a33ad2-49f9-4c92-bb95-ade1c9bd2493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a33ad2-49f9-4c92-bb95-ade1c9bd2493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325290109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27a0c1a-9c6d-425d-9090-d5df1ec92f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:52Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5258ccf-86d0-4782-8b08-6f29477447e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5258ccf-86d0-4782-8b08-6f29477447e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7152d88-938b-408a-9644-3550b7efaece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7152d88-938b-408a-9644-3550b7efaece) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b27a0c1a-9c6d-425d-9090-d5df1ec92f66', 'volume_name': 'volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:51 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a6d1fd-0ef8-4b1a-a47c-02785a80506a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a6d1fd-0ef8-4b1a-a47c-02785a80506a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b39e2ff-30d5-486c-8986-52f4c82fe6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Volume b27a0c1a-9c6d-425d-9090-d5df1ec92f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66', 'volume_size': 1}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.840s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Deleted volume successfully.
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b9d9bc4e-dc9d-4343-8d83-61425ec7d159 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-9c308766-c3f7-463c-9b64-92a2a15543e4-delete_volume" released by "delete_volume" :: held 3.041s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:51 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:11:51 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:52 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b7fe6f2-2726-4fff-940e-78524e648077 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b" returned: 0 in 0.795s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:52 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b is being set with open permissions: ugo+rw
Jul 06 21:11:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:52 devstack sudo[106980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b
Jul 06 21:11:52 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:52 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.751s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:52 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:11:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Deleted volume successfully.
Jul 06 21:11:52 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ba1062-3c2e-4fdc-963d-df5b0adc8034 tempest-ProjectReaderTests-535855104 None] Lock "cinder-f29b0339-d26a-4447-9533-1358cb4dd50d-delete_volume" released by "delete_volume" :: held 3.031s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:52 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b" returned: 0 in 0.710s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:52 devstack sudo[106984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.info
Jul 06 21:11:52 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:53 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.info" returned: 0 in 0.772s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:53 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.info is being set with open permissions: ugo+rw
Jul 06 21:11:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:53 devstack sudo[106987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.info
Jul 06 21:11:53 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:54 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.info" returned: 0 in 0.735s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.239s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325290109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b27a0c1a-9c6d-425d-9090-d5df1ec92f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:52Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Creating volume b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:11:54 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:11:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:54 devstack sudo[106990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 1073741824
Jul 06 21:11:54 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:54 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ce80da3c-da48-46bb-bf37-6a82868647f4 tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-2557addf-6302-435a-a6de-f9571140d37b-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:55 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Lock "cinder-2557addf-6302-435a-a6de-f9571140d37b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-1b7fe6f2-2726-4fff-940e-78524e648077" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 1073741824" returned: 0 in 0.850s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-1b7fe6f2-2726-4fff-940e-78524e648077" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-2557addf-6302-435a-a6de-f9571140d37b" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-2557addf-6302-435a-a6de-f9571140d37b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot 2557addf-6302-435a-a6de-f9571140d37b of volume 1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94cc3ad-94c3-435b-9bd3-a10bd1630b34]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:55 devstack sudo[106996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66
Jul 06 21:11:55 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:55 devstack sudo[106997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b
Jul 06 21:11:55 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:55 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" returned: 0 in 0.675s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] <== create_volume: return (1613ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.616s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b39e2ff-30d5-486c-8986-52f4c82fe6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:55 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe0b929-cf09-4166-90a0-497b9bf13cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:11:55 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Volume volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 (b27a0c1a-9c6d-425d-9090-d5df1ec92f66): created successfully
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfe0b929-cf09-4166-90a0-497b9bf13cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (09a43daa-007d-42e2-9841-03ecc40515dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:11:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8e745c0c-defc-4686-858d-66c3b3b88b6f tempest-ProjectReaderTests-1922464028 None] Created volume successfully.
Jul 06 21:11:56 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b" returned: 0 in 0.826s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b7fe6f2-2726-4fff-940e-78524e648077(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c71f9d-dbfa-4c2f-9a65-b7f8637f68ee]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:56 devstack sudo[107004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077
Jul 06 21:11:56 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:56 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077" returned: 0 in 0.807s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:56 devstack sudo[107009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b
Jul 06 21:11:56 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Creating offline snapshot 4b273453-9019-4070-882b-741a390ec9c8 of volume b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea4b61e-daa3-4dff-80ca-bc9d1aa139a7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:57 devstack sudo[107011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66
Jul 06 21:11:57 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:57 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b" returned: 0 in 0.737s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:57 devstack sudo[107017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b
Jul 06 21:11:57 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:57 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" returned: 0 in 0.806s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:57 devstack sudo[107021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 1G
Jul 06 21:11:57 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:58 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077.2557addf-6302-435a-a6de-f9571140d37b" returned: 0 in 0.667s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-2557addf-6302-435a-a6de-f9571140d37b" released by "_delete_snapshot" :: held 3.160s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-1b7fe6f2-2726-4fff-940e-78524e648077" released by "delete_snapshot" :: held 3.187s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:58 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Created reservations ['e68e8600-2277-4cc4-9db4-a42406ad658a', '97fa3394-cd12-4d42-95d8-9660d1a1b4e1', '94f8ceb9-4253-4006-9c9f-3ee15f3cee75', '4ca2d4ca-4f1b-47f2-9b80-37b01c813b3d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:11:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:11:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f1b5ea92-1bff-4578-84bb-a15b014536bf tempest-ProjectMemberTests-403782602 None] Lock "cinder-2557addf-6302-435a-a6de-f9571140d37b-delete_snapshot" released by "delete_snapshot" :: held 3.342s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:11:58 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 1G" returned: 0 in 0.857s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:58 devstack sudo[107029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8
Jul 06 21:11:58 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:59 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8" returned: 0 in 0.687s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:11:59 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 is being set with open permissions: ugo+rw
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-1b7fe6f2-2726-4fff-940e-78524e648077-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:59 devstack sudo[107034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8
Jul 06 21:11:59 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Lock "cinder-1b7fe6f2-2726-4fff-940e-78524e648077-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-1b7fe6f2-2726-4fff-940e-78524e648077" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-1b7fe6f2-2726-4fff-940e-78524e648077" acquired by "delete_volume" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed529e2e-8318-4106-b0a0-923c8e9ea96f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:11:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:11:59 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077
Jul 06 21:11:59 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:00 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8" returned: 0 in 0.676s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:00 devstack sudo[107039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.info
Jul 06 21:12:00 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:00 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077" returned: 0 in 0.788s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:00 devstack sudo[107045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077
Jul 06 21:12:00 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:00 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.info" returned: 0 in 0.635s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:00 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.info is being set with open permissions: ugo+rw
Jul 06 21:12:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:00 devstack sudo[107048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.info
Jul 06 21:12:00 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:01 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-1b7fe6f2-2726-4fff-940e-78524e648077" returned: 0 in 0.686s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-1b7fe6f2-2726-4fff-940e-78524e648077" released by "delete_volume" :: held 1.528s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Created reservations ['a2ca9fa3-8fba-4109-b3f3-1e0aba9187aa', '0e23f4ed-e6c6-4c26-98e5-a1e5cf6e94e2', 'f0aac702-ce58-4bbe-a10e-4ca0f64e284b', 'df566352-1a14-4c1a-bc21-54c8f76493a5'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:01 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:01 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:01 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.info" returned: 0 in 0.720s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.473s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:01 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-60f624ef-5468-4b5d-b8e5-0eec18a0ff91 tempest-ProjectReaderTests-1922464028 None] Create snapshot completed successfully
Jul 06 21:12:01 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.707s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:01 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:12:01 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-9ce7910a-c6ce-4c61-91c9-981fd8223c82 tempest-ProjectMemberTests-403782602 None] Lock "cinder-1b7fe6f2-2726-4fff-940e-78524e648077-delete_volume" released by "delete_volume" :: held 2.465s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (ca1c4887-9151-44a4-bbbf-65c02f682d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469d782-abfe-47a0-9f84-b8857f7ace2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8469d782-abfe-47a0-9f84-b8857f7ace2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103845443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e265e69e-0428-4a5f-a19b-87b052720f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:02Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ffac13-2fa8-4757-832b-233bd0934264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ffac13-2fa8-4757-832b-233bd0934264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de68bd89-14d8-46f8-a9fd-e58678230642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de68bd89-14d8-46f8-a9fd-e58678230642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e265e69e-0428-4a5f-a19b-87b052720f88', 'volume_name': 'volume-e265e69e-0428-4a5f-a19b-87b052720f88', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727e9582-ae9a-415a-b4bf-db3fae4d92cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (727e9582-ae9a-415a-b4bf-db3fae4d92cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317487b5-4c96-4a66-bf65-d13e28f866ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:02 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Volume e265e69e-0428-4a5f-a19b-87b052720f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e265e69e-0428-4a5f-a19b-87b052720f88', 'volume_size': 1}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103845443',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e265e69e-0428-4a5f-a19b-87b052720f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:02Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Creating volume e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:12:02 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:02 devstack sudo[107055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 1073741824
Jul 06 21:12:02 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-4b273453-9019-4070-882b-741a390ec9c8-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-4b273453-9019-4070-882b-741a390ec9c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-4b273453-9019-4070-882b-741a390ec9c8" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-4b273453-9019-4070-882b-741a390ec9c8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Deleting offline snapshot 4b273453-9019-4070-882b-741a390ec9c8 of volume b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] snapshot_file for this snap is: volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8584746-9d6f-4dce-9b48-546ee55284f0]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:02 devstack sudo[107057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8
Jul 06 21:12:02 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:03 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 1073741824" returned: 0 in 0.913s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:03 devstack sudo[107065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88
Jul 06 21:12:03 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:03 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8" returned: 0 in 0.807s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcde0d55-52aa-4647-913e-7d7302719975]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:03 devstack sudo[107067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66
Jul 06 21:12:03 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:03 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88" returned: 0 in 0.710s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (317487b5-4c96-4a66-bf65-d13e28f866ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e265e69e-0428-4a5f-a19b-87b052720f88', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4718f7d1-215f-41bf-85ce-5182e443a903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:03 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Volume volume-e265e69e-0428-4a5f-a19b-87b052720f88 (e265e69e-0428-4a5f-a19b-87b052720f88): created successfully
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4718f7d1-215f-41bf-85ce-5182e443a903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:03 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (ca1c4887-9151-44a4-bbbf-65c02f682d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:03 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e5e3da0a-bf16-46cd-b6b8-ccaa52da7180 tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:12:04 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" returned: 0 in 0.839s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:04 devstack sudo[107073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8
Jul 06 21:12:04 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Creating offline snapshot 29d389a6-8225-41ab-ae5e-849f441df453 of volume e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[56be8f4b-20dc-4aa0-b57a-6ae7d9d0c097]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:04 devstack sudo[107075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88
Jul 06 21:12:04 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:04 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8" returned: 0 in 0.859s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:04 devstack sudo[107080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8
Jul 06 21:12:04 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:05 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88" returned: 0 in 0.794s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:05 devstack sudo[107085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 1G
Jul 06 21:12:05 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:05 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66.4b273453-9019-4070-882b-741a390ec9c8" returned: 0 in 0.715s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-4b273453-9019-4070-882b-741a390ec9c8" released by "_delete_snapshot" :: held 3.341s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" released by "delete_snapshot" :: held 3.369s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:05 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Created reservations ['172ab283-5d06-4ed3-ad55-787a4b54191c', 'f6dac3d7-790d-4ed4-b96e-0ee6d67dc27c', '918d65fb-8d91-422e-87fe-a924291c9d20', '7ebdc9c8-1259-4e4c-aefb-a69758399fb6'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Delete snapshot completed successfully.
Jul 06 21:12:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6b82b0be-3482-4d03-82cb-932e267de739 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-4b273453-9019-4070-882b-741a390ec9c8-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:06 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 1G" returned: 0 in 0.869s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e265e69e-0428-4a5f-a19b-87b052720f88 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:06 devstack sudo[107091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e265e69e-0428-4a5f-a19b-87b052720f88 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453
Jul 06 21:12:06 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-b27a0c1a-9c6d-425d-9090-d5df1ec92f66-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-b27a0c1a-9c6d-425d-9090-d5df1ec92f66-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c223160-ba27-4c01-bc81-4e6e08d965d7]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:06 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66
Jul 06 21:12:06 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:06 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e265e69e-0428-4a5f-a19b-87b052720f88 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453" returned: 0 in 0.719s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:06 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 is being set with open permissions: ugo+rw
Jul 06 21:12:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:06 devstack sudo[107098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453
Jul 06 21:12:06 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:07 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" returned: 0 in 0.801s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:07 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453" returned: 0 in 0.668s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:07 devstack sudo[107104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66
Jul 06 21:12:07 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:07 devstack sudo[107106]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.info
Jul 06 21:12:07 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:08 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" returned: 0 in 0.676s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:08 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.info" returned: 0 in 0.652s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:08 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.info is being set with open permissions: ugo+rw
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-b27a0c1a-9c6d-425d-9090-d5df1ec92f66" released by "delete_volume" :: held 1.549s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:08 devstack sudo[107110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.info
Jul 06 21:12:08 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Created reservations ['3a902131-f70b-49cb-9c0a-8cdd5d3985c3', 'ac7059d6-4c99-4a88-a6d9-b102b64aedae', '5d187d79-6b2f-4f61-bb86-d12c45c23a65', 'd473110b-481d-45db-b01a-ed7589f72561'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:08 devstack sudo[107113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:08 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:08 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.info" returned: 0 in 0.701s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.499s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:08 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b1295512-3f32-4dcc-a76e-52c66ca63a30 tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:12:09 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.732s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Deleted volume successfully.
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f225fd98-d45d-48ac-b68f-015980e921e0 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-b27a0c1a-9c6d-425d-9090-d5df1ec92f66-delete_volume" released by "delete_volume" :: held 2.543s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (641e0c93-6c02-448e-a649-cea43179f683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64feaee5-ee67-4786-9cf0-a9bb45780578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64feaee5-ee67-4786-9cf0-a9bb45780578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553687789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0641736-a4db-4d17-a4d5-35cac2e52e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:09Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956ec52-a2f4-46de-b0fc-c120f7776094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4956ec52-a2f4-46de-b0fc-c120f7776094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08d4d62-e456-47c0-bc94-d5f714402c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a08d4d62-e456-47c0-bc94-d5f714402c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0641736-a4db-4d17-a4d5-35cac2e52e99', 'volume_name': 'volume-a0641736-a4db-4d17-a4d5-35cac2e52e99', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790f05ed-feea-4295-a79d-3615f67bd97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790f05ed-feea-4295-a79d-3615f67bd97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a9c786-5de0-49cd-9fd7-563a7f7289fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:09 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Volume a0641736-a4db-4d17-a4d5-35cac2e52e99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0641736-a4db-4d17-a4d5-35cac2e52e99', 'volume_size': 1}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1553687789',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0641736-a4db-4d17-a4d5-35cac2e52e99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:09Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Creating volume a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:12:09 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:09 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 1073741824
Jul 06 21:12:09 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-29d389a6-8225-41ab-ae5e-849f441df453-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Lock "cinder-29d389a6-8225-41ab-ae5e-849f441df453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-e265e69e-0428-4a5f-a19b-87b052720f88" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e265e69e-0428-4a5f-a19b-87b052720f88" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-29d389a6-8225-41ab-ae5e-849f441df453" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-29d389a6-8225-41ab-ae5e-849f441df453" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot 29d389a6-8225-41ab-ae5e-849f441df453 of volume e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae38bf43-b509-447d-b822-66aa96446e56]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:09 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453
Jul 06 21:12:09 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:10 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 1073741824" returned: 0 in 0.935s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:10 devstack sudo[107125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99
Jul 06 21:12:10 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:10 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453" returned: 0 in 0.840s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:10 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e265e69e-0428-4a5f-a19b-87b052720f88(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:12:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6004c6-edce-4aba-b7d8-cbc47d173b91]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:10 devstack sudo[107129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88
Jul 06 21:12:10 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:11 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99" returned: 0 in 0.694s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a9c786-5de0-49cd-9fd7-563a7f7289fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0641736-a4db-4d17-a4d5-35cac2e52e99', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751861d3-0c07-4abe-96b5-1087fec0d675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:11 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Volume volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 (a0641736-a4db-4d17-a4d5-35cac2e52e99): created successfully
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751861d3-0c07-4abe-96b5-1087fec0d675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (641e0c93-6c02-448e-a649-cea43179f683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-160ef852-1499-4bb9-8830-e884ff86719b tempest-ProjectReaderTests-1922464028 None] Created volume successfully.
Jul 06 21:12:11 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88" returned: 0 in 0.831s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:11 devstack sudo[107135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453
Jul 06 21:12:11 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Creating offline snapshot b9ea5ba0-09d0-4ce7-88fa-accc22779978 of volume a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91255f1-3ed3-42ea-9815-19e23cd39444]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:11 devstack sudo[107137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99
Jul 06 21:12:11 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:12 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453" returned: 0 in 0.830s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:12 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453
Jul 06 21:12:12 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:12 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99" returned: 0 in 0.860s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:12 devstack sudo[107147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 1G
Jul 06 21:12:12 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:12 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88.29d389a6-8225-41ab-ae5e-849f441df453" returned: 0 in 0.665s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-29d389a6-8225-41ab-ae5e-849f441df453" released by "_delete_snapshot" :: held 3.272s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e265e69e-0428-4a5f-a19b-87b052720f88" released by "delete_snapshot" :: held 3.302s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:12 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Created reservations ['5a63a25b-8a7d-454c-b144-71f76d46f03f', 'f135233f-22b9-4146-ae9a-1574f1ec6937', '13913a9c-57fd-48f0-9aa9-7d7082e1df29', 'b076691e-cecf-493d-af6e-c1cb93068c20'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-74999ce8-b0e6-46f4-b533-bb601e797a0b tempest-ProjectMemberTests-403782602 None] Lock "cinder-29d389a6-8225-41ab-ae5e-849f441df453-delete_snapshot" released by "delete_snapshot" :: held 3.455s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:13 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 1G" returned: 0 in 0.905s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:13 devstack sudo[107153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978
Jul 06 21:12:13 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-e265e69e-0428-4a5f-a19b-87b052720f88-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Lock "cinder-e265e69e-0428-4a5f-a19b-87b052720f88-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-e265e69e-0428-4a5f-a19b-87b052720f88" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e265e69e-0428-4a5f-a19b-87b052720f88" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeec357-4475-4150-ad09-9fd5f65c5ee4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:14 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978" returned: 0 in 0.750s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:14 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 is being set with open permissions: ugo+rw
Jul 06 21:12:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:14 devstack sudo[107159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978
Jul 06 21:12:14 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:14 devstack sudo[107158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88
Jul 06 21:12:14 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:14 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978" returned: 0 in 0.696s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:14 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88" returned: 0 in 0.822s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:14 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.info
Jul 06 21:12:14 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:14 devstack sudo[107167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88
Jul 06 21:12:14 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:15 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.info" returned: 0 in 0.704s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:15 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:15 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.info is being set with open permissions: ugo+rw
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-e265e69e-0428-4a5f-a19b-87b052720f88" returned: 0 in 0.693s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:15 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.info
Jul 06 21:12:15 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-e265e69e-0428-4a5f-a19b-87b052720f88" released by "delete_volume" :: held 1.586s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Created reservations ['effac555-437d-4b9a-866f-cdd895e65269', '5f7c7344-f4e2-421e-9674-5e0785736bbc', '4c7af170-880e-4d3b-92c1-c84aed92859b', '201453ce-5d62-4150-8ac5-3debcb901a07'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:15 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:15 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:16 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.info" returned: 0 in 0.706s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.724s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d4032c17-1adc-476d-b7ff-2b19e6392db8 tempest-ProjectReaderTests-1922464028 None] Create snapshot completed successfully
Jul 06 21:12:16 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.714s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:16 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-24cc6f0d-1f9d-4b61-8bd7-ae21f7e202e1 tempest-ProjectMemberTests-403782602 None] Lock "cinder-e265e69e-0428-4a5f-a19b-87b052720f88-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (24810b23-3a51-41fb-833f-284ee0924106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8f44b7-ec58-45ce-b7e3-50b0da655608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b8f44b7-ec58-45ce-b7e3-50b0da655608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090022316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84658894-469a-4a1b-a9db-9a8683e78aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:17Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99ef5c8-33f2-4f6e-b111-8e6a990bf4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a99ef5c8-33f2-4f6e-b111-8e6a990bf4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc8df7-2724-4266-b58a-1d8b2d324e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88bc8df7-2724-4266-b58a-1d8b2d324e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84658894-469a-4a1b-a9db-9a8683e78aaa', 'volume_name': 'volume-84658894-469a-4a1b-a9db-9a8683e78aaa', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47de169c-1345-4b4d-8fca-2ca6ebbd1b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47de169c-1345-4b4d-8fca-2ca6ebbd1b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4f24a4-1c15-44b6-9f73-72818d74ae86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:16 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Volume 84658894-469a-4a1b-a9db-9a8683e78aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84658894-469a-4a1b-a9db-9a8683e78aaa', 'volume_size': 1}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090022316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84658894-469a-4a1b-a9db-9a8683e78aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:17Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Creating volume 84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:12:16 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-b9ea5ba0-09d0-4ce7-88fa-accc22779978-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:16 devstack sudo[107214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa 1073741824
Jul 06 21:12:16 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-b9ea5ba0-09d0-4ce7-88fa-accc22779978-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-a0641736-a4db-4d17-a4d5-35cac2e52e99" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-a0641736-a4db-4d17-a4d5-35cac2e52e99" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-b9ea5ba0-09d0-4ce7-88fa-accc22779978" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-b9ea5ba0-09d0-4ce7-88fa-accc22779978" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Deleting offline snapshot b9ea5ba0-09d0-4ce7-88fa-accc22779978 of volume a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] snapshot_file for this snap is: volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dd9572-7206-4baf-a835-5698c99e3bd4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:16 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:16 devstack sudo[107216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978
Jul 06 21:12:16 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:17 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa 1073741824" returned: 0 in 0.881s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:17 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978" returned: 0 in 0.812s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:17 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0641736-a4db-4d17-a4d5-35cac2e52e99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:12:17 devstack sudo[107224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa
Jul 06 21:12:17 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:17 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[890ce0be-ee72-48b0-a165-17447f597c4a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:17 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:17 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99
Jul 06 21:12:17 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:18 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa" returned: 0 in 0.678s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f4f24a4-1c15-44b6-9f73-72818d74ae86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84658894-469a-4a1b-a9db-9a8683e78aaa', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e2fe4b-3ca6-42fb-8205-c88d441ee28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:18 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Volume volume-84658894-469a-4a1b-a9db-9a8683e78aaa (84658894-469a-4a1b-a9db-9a8683e78aaa): created successfully
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35e2fe4b-3ca6-42fb-8205-c88d441ee28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (24810b23-3a51-41fb-833f-284ee0924106) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:18 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-eb2607cd-6ff0-4723-954d-83c36fd118b4 tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:12:18 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99" returned: 0 in 0.783s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:18 devstack sudo[107234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978
Jul 06 21:12:18 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Creating offline snapshot 534ad590-a93e-4c75-b38e-a29e00f000d2 of volume 84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d80d563-bb6a-4b5c-9815-e3f1db023aa6]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:18 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:19 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa
Jul 06 21:12:19 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:19 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978" returned: 0 in 0.770s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:19 devstack sudo[107241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978
Jul 06 21:12:19 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:19 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa" returned: 0 in 0.796s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:19 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 1G
Jul 06 21:12:19 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:19 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99.b9ea5ba0-09d0-4ce7-88fa-accc22779978" returned: 0 in 0.658s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-b9ea5ba0-09d0-4ce7-88fa-accc22779978" released by "_delete_snapshot" :: held 3.133s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-a0641736-a4db-4d17-a4d5-35cac2e52e99" released by "delete_snapshot" :: held 3.157s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:19 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Created reservations ['438f49a9-99cc-4e5d-8bef-ede0007d926e', '2719b063-66d9-4545-85a4-641f545c746b', 'e78eee00-e6e0-4d84-87a1-c3e7e70172e1', '2bbdfac6-57cc-4c4b-aeb2-af86563e6f19'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:20 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Delete snapshot completed successfully.
Jul 06 21:12:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cf075ac1-8442-4d4d-85cf-c61674e38337 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-b9ea5ba0-09d0-4ce7-88fa-accc22779978-delete_snapshot" released by "delete_snapshot" :: held 3.293s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:20 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 1G" returned: 0 in 0.791s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:20 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84658894-469a-4a1b-a9db-9a8683e78aaa -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:20 devstack sudo[107253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84658894-469a-4a1b-a9db-9a8683e78aaa -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2
Jul 06 21:12:20 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-a0641736-a4db-4d17-a4d5-35cac2e52e99-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:20 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-a0641736-a4db-4d17-a4d5-35cac2e52e99-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-a0641736-a4db-4d17-a4d5-35cac2e52e99" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-a0641736-a4db-4d17-a4d5-35cac2e52e99" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[d847ebfc-23eb-4162-935e-2a8f8837921f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:21 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84658894-469a-4a1b-a9db-9a8683e78aaa -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2" returned: 0 in 0.695s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:21 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 is being set with open permissions: ugo+rw
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:21 devstack sudo[107258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99
Jul 06 21:12:21 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:21 devstack sudo[107260]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2
Jul 06 21:12:21 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:21 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2" returned: 0 in 0.659s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:21 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99" returned: 0 in 0.797s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:21 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:21 devstack sudo[107267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99
Jul 06 21:12:21 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:21 devstack sudo[107268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.info
Jul 06 21:12:21 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:22 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-a0641736-a4db-4d17-a4d5-35cac2e52e99" returned: 0 in 0.671s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:22 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.info" returned: 0 in 0.667s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:22 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.info is being set with open permissions: ugo+rw
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-a0641736-a4db-4d17-a4d5-35cac2e52e99" released by "delete_volume" :: held 1.539s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:22 devstack sudo[107279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.info
Jul 06 21:12:22 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Created reservations ['8eece40a-0444-40a1-8d79-be35f398916e', '73741b52-e8bc-40f3-82d5-dfea59ee56a4', '62c97f72-552b-467b-85cf-5ce42d7c9730', '856f797e-ebc1-4133-a39f-945019a27b63'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:22 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:22 devstack sudo[107281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:22 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:23 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.info" returned: 0 in 0.656s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.367s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-9d147b96-105c-4b0e-b393-a400a0c32ce3 tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:12:23 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.658s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:23 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Deleted volume successfully.
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-749877e1-cc80-4d69-bd0a-4c37f9f5bc55 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-a0641736-a4db-4d17-a4d5-35cac2e52e99-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (f0b0246e-efcd-47d9-99c3-b687c7f24710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af24aef8-dd4a-48ac-b304-263aef1b83af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af24aef8-dd4a-48ac-b304-263aef1b83af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937723574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9568ee54-4fb4-406a-ac87-2e4d6e8784d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:24Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed6ffc3-6635-4f7c-8e77-1e14e8393b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ed6ffc3-6635-4f7c-8e77-1e14e8393b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5d746c-7229-45ef-8fa1-5e5fe2ae68f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab5d746c-7229-45ef-8fa1-5e5fe2ae68f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9568ee54-4fb4-406a-ac87-2e4d6e8784d6', 'volume_name': 'volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8d47a3-50e4-4ae7-b2a4-6efb823bf32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8d47a3-50e4-4ae7-b2a4-6efb823bf32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c451b2-3b7c-4fbe-a6e1-5f21ae266f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:23 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Volume 9568ee54-4fb4-406a-ac87-2e4d6e8784d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6', 'volume_size': 1}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-937723574',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9568ee54-4fb4-406a-ac87-2e4d6e8784d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1db5217ab08f44dbbc9c9825800bba4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:24Z,use_quota=True,user_id='360dc832b290417cb40264fc57ba8b0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Creating volume 9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:12:23 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:12:23 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:23 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 1073741824
Jul 06 21:12:23 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-534ad590-a93e-4c75-b38e-a29e00f000d2-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Lock "cinder-534ad590-a93e-4c75-b38e-a29e00f000d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-84658894-469a-4a1b-a9db-9a8683e78aaa" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-84658894-469a-4a1b-a9db-9a8683e78aaa" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-534ad590-a93e-4c75-b38e-a29e00f000d2" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-534ad590-a93e-4c75-b38e-a29e00f000d2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot 534ad590-a93e-4c75-b38e-a29e00f000d2 of volume 84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[262de62b-f9f7-4662-91c7-7a75e83fb4da]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:24 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2
Jul 06 21:12:24 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:24 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 1073741824" returned: 0 in 0.868s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:24 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:24 devstack sudo[107292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6
Jul 06 21:12:24 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:25 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2" returned: 0 in 0.818s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84658894-469a-4a1b-a9db-9a8683e78aaa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[7895c01e-48cc-4da5-8d88-af6559150b31]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:25 devstack sudo[107297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa
Jul 06 21:12:25 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:25 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" returned: 0 in 0.669s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] <== create_volume: return (1577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.580s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c451b2-3b7c-4fbe-a6e1-5f21ae266f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb3bebb-55e5-421c-bf79-4c79c93446b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:25 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Volume volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 (9568ee54-4fb4-406a-ac87-2e4d6e8784d6): created successfully
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb3bebb-55e5-421c-bf79-4c79c93446b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Flow 'volume_create_manager' (f0b0246e-efcd-47d9-99c3-b687c7f24710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:25 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5b514725-972b-44ca-9b3f-b48fc599a48e tempest-ProjectReaderTests-1922464028 None] Created volume successfully.
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Creating offline snapshot 04eb5371-6aaf-4421-b2c2-c49415a00f3e of volume 9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[713a561c-90bc-4b12-888a-80695cb0e12a]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:25 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa" returned: 0 in 0.842s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:25 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:25 devstack sudo[107304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2
Jul 06 21:12:25 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:26 devstack sudo[107303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6
Jul 06 21:12:26 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:26 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:26 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2" returned: 0 in 0.762s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" returned: 0 in 0.790s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:26 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:26 devstack sudo[107313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2
Jul 06 21:12:26 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:26 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e 1G
Jul 06 21:12:26 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:27 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa.534ad590-a93e-4c75-b38e-a29e00f000d2" returned: 0 in 0.696s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-534ad590-a93e-4c75-b38e-a29e00f000d2" released by "_delete_snapshot" :: held 3.235s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-84658894-469a-4a1b-a9db-9a8683e78aaa" released by "delete_snapshot" :: held 3.259s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:27 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Created reservations ['43e067f0-cbb0-4166-8bab-afbdc84cf20c', '83066880-1ebd-4ea3-bf54-c468d3609571', 'd34a8587-c2eb-4695-87d6-0ba164776baf', '9501a7a9-a8c1-4729-85e2-c196591bbf8c'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:27 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e 1G" returned: 0 in 0.830s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:27 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:27 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:12:27 devstack sudo[107322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e
Jul 06 21:12:27 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:27 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ad3627ea-cdbd-4ed8-b5a4-b7c33e59fae0 tempest-ProjectMemberTests-403782602 None] Lock "cinder-534ad590-a93e-4c75-b38e-a29e00f000d2-delete_snapshot" released by "delete_snapshot" :: held 3.438s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:28 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e" returned: 0 in 0.679s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:28 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e is being set with open permissions: ugo+rw
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:28 devstack sudo[107327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e
Jul 06 21:12:28 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-84658894-469a-4a1b-a9db-9a8683e78aaa-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Lock "cinder-84658894-469a-4a1b-a9db-9a8683e78aaa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-84658894-469a-4a1b-a9db-9a8683e78aaa" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-84658894-469a-4a1b-a9db-9a8683e78aaa" acquired by "delete_volume" :: waited 0.027s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddec0ea3-bbf3-4b33-a321-1af873d0cb53]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:28 devstack sudo[107330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa
Jul 06 21:12:28 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:28 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e" returned: 0 in 0.706s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:28 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:29 devstack sudo[107333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.info
Jul 06 21:12:29 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:29 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa" returned: 0 in 0.786s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:29 devstack sudo[107338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa
Jul 06 21:12:29 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:29 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.info" returned: 0 in 0.676s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:29 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.info is being set with open permissions: ugo+rw
Jul 06 21:12:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:29 devstack sudo[107341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.info
Jul 06 21:12:29 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:29 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:29 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-84658894-469a-4a1b-a9db-9a8683e78aaa" returned: 0 in 0.697s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:29 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-84658894-469a-4a1b-a9db-9a8683e78aaa" released by "delete_volume" :: held 1.544s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Created reservations ['d7562c05-0bd9-4b74-865a-e17ce60efa56', '81338604-7af7-477f-90da-189ab90a937a', '25c917f1-452a-4dbe-a7ed-7f7205385974', 'cd1535cd-15e7-4a4a-8424-aed4e25d813d'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:30 devstack sudo[107344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:30 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:30 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.info" returned: 0 in 0.695s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.477s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cc357143-64b3-41f8-81c6-e533279a0e31 tempest-ProjectReaderTests-1922464028 None] Create snapshot completed successfully
Jul 06 21:12:30 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.672s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:30 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:12:30 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-2f5e71e4-79ca-47dd-a06f-03c20b984ebd tempest-ProjectMemberTests-403782602 None] Lock "cinder-84658894-469a-4a1b-a9db-9a8683e78aaa-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (0baa910e-54cd-4759-99b9-87d78a59ed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db851889-6403-48b3-84ba-7d35dc6445b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db851889-6403-48b3-84ba-7d35dc6445b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-683026095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:31Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a27697c-f8ba-4e1c-badb-3313793c94ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a27697c-f8ba-4e1c-badb-3313793c94ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b09e93f-84e6-4eb2-a339-59ecb17bdcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b09e93f-84e6-4eb2-a339-59ecb17bdcdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83', 'volume_name': 'volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94aadb0-fe3a-4097-8792-0232563c7ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b94aadb0-fe3a-4097-8792-0232563c7ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc29b2d-042f-4e9f-8550-de8af003de0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:31 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Volume 8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83', 'volume_size': 1}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-683026095',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:31Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Creating volume 8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:12:31 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-04eb5371-6aaf-4421-b2c2-c49415a00f3e-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:31 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 1073741824
Jul 06 21:12:31 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Lock "cinder-04eb5371-6aaf-4421-b2c2-c49415a00f3e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-04eb5371-6aaf-4421-b2c2-c49415a00f3e" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-04eb5371-6aaf-4421-b2c2-c49415a00f3e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Deleting offline snapshot 04eb5371-6aaf-4421-b2c2-c49415a00f3e of volume 9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] snapshot_file for this snap is: volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab49f84-90a6-48e8-be1c-eee09454af17]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:31 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e
Jul 06 21:12:31 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:31 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:31 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 1073741824" returned: 0 in 0.834s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:32 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83
Jul 06 21:12:32 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:32 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e" returned: 0 in 0.817s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a5b33-981c-48b6-ada6-ffddd02bc8da]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:32 devstack sudo[107360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6
Jul 06 21:12:32 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:32 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" returned: 0 in 0.665s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1551ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbc29b2d-042f-4e9f-8550-de8af003de0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f061e62-e8e2-40cb-93fc-7259608ea826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:32 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Volume volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 (8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83): created successfully
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f061e62-e8e2-40cb-93fc-7259608ea826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (0baa910e-54cd-4759-99b9-87d78a59ed58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:32 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-16d6f94c-552a-4458-83dd-410ca3d53fee tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:12:32 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:32 devstack sudo[107368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" returned: 0 in 0.792s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:32 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:32 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:33 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Creating offline snapshot 55953abd-c527-4686-bdd0-3bfec352aa7b of volume 8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:12:33 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4406270b-157e-426e-b4cc-f7c71b2d3f8f]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:33 devstack sudo[107370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83
Jul 06 21:12:33 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:33 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e" returned: 0 in 0.801s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:33 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:33 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e
Jul 06 21:12:33 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:34 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" returned: 0 in 0.811s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:34 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b 1G
Jul 06 21:12:34 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:34 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:34 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6.04eb5371-6aaf-4421-b2c2-c49415a00f3e" returned: 0 in 0.709s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-04eb5371-6aaf-4421-b2c2-c49415a00f3e" released by "_delete_snapshot" :: held 3.217s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" released by "delete_snapshot" :: held 3.243s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:34 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Created reservations ['85a316d2-a12d-4484-9276-c8a97f5ab4aa', 'b294a6ed-daad-46da-82df-af84b4cae023', 'c50471d8-afb3-4107-927c-a805d72ec14f', 'f1043539-0cd1-439a-b6d9-88e60e1eda4e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:34 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Delete snapshot completed successfully.
Jul 06 21:12:34 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a03f189c-45f7-4824-a55b-f69ae352a64f tempest-ProjectReaderTests-1922464028 None] Lock "cinder-04eb5371-6aaf-4421-b2c2-c49415a00f3e-delete_snapshot" released by "delete_snapshot" :: held 3.379s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:35 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b 1G" returned: 0 in 0.833s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:35 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b
Jul 06 21:12:35 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-9568ee54-4fb4-406a-ac87-2e4d6e8784d6-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-9568ee54-4fb4-406a-ac87-2e4d6e8784d6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "cinder-quobyte-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d158c1-f2ba-4729-be24-70d11a9a091d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:35 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6
Jul 06 21:12:35 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:35 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b" returned: 0 in 0.727s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:35 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b is being set with open permissions: ugo+rw
Jul 06 21:12:35 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:35 devstack sudo[107394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b
Jul 06 21:12:35 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:36 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" returned: 0 in 0.779s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:36 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6
Jul 06 21:12:36 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:36 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b" returned: 0 in 0.659s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:36 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=175,cinder:DELETE=19,cinder:SELECT=121,cinder:INSERT=52 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:12:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:36 devstack sudo[107402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.info
Jul 06 21:12:36 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:36 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:36 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" returned: 0 in 0.681s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:36 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-quobyte-9568ee54-4fb4-406a-ac87-2e4d6e8784d6" released by "delete_volume" :: held 1.523s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=140,cinder:INSERT=42,cinder:UPDATE=176,cinder:DELETE=10 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Created reservations ['9ac10b12-2119-4e1e-9119-95d69bed540a', '72033fff-e9fc-446b-8c7f-cbca80ade736', 'a3dfea9d-8093-4bf9-9af8-b8cd76c0ecbc', '70da747a-5af2-4a80-acfb-cef9281a3ac7'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:37 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.info" returned: 0 in 0.688s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:37 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.info is being set with open permissions: ugo+rw
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:37 devstack sudo[107406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:37 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:37 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.info
Jul 06 21:12:37 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:37 devstack sudo[107410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:37 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:37 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.685s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:37 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Deleted volume successfully.
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.info" returned: 0 in 0.697s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.515s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:37 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-ddc7ceac-2669-46f0-859e-2a18d9a1e699 tempest-ProjectReaderTests-1922464028 None] Lock "cinder-9568ee54-4fb4-406a-ac87-2e4d6e8784d6-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:37 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-482b900e-5fe1-41db-8fb5-09572ec96812 tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:12:38 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.702s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-55953abd-c527-4686-bdd0-3bfec352aa7b-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Lock "cinder-55953abd-c527-4686-bdd0-3bfec352aa7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-55953abd-c527-4686-bdd0-3bfec352aa7b" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-55953abd-c527-4686-bdd0-3bfec352aa7b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot 55953abd-c527-4686-bdd0-3bfec352aa7b of volume 8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[202ae52a-e89f-4efc-9ad8-3322d0358658]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:38 devstack sudo[107416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b
Jul 06 21:12:38 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:39 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b" returned: 0 in 0.847s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:39 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:12:39 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e05be8-a1e2-4cb8-8339-fa5c9cbf028c]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:39 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:39 devstack sudo[107423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83
Jul 06 21:12:39 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:40 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" returned: 0 in 0.794s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:40 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:40 devstack sudo[107428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b
Jul 06 21:12:40 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:41 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b" returned: 0 in 0.798s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:41 devstack sudo[107436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b
Jul 06 21:12:41 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:41 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:41 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83.55953abd-c527-4686-bdd0-3bfec352aa7b" returned: 0 in 0.680s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-55953abd-c527-4686-bdd0-3bfec352aa7b" released by "_delete_snapshot" :: held 3.228s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:41 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" released by "delete_snapshot" :: held 3.248s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:41 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Created reservations ['aff4b1ca-87ad-4169-9b28-20875da9eb5e', 'd0a59a0d-f89b-43d5-9f68-352dd9544d05', 'f242922c-8bef-4d4b-83f4-afee2177e469', '8e73f60a-8cbd-47c7-9274-5e5962b6cf79'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:42 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:12:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-f193614e-d1cc-4424-b9c6-16288f73ee00 tempest-ProjectMemberTests-403782602 None] Lock "cinder-55953abd-c527-4686-bdd0-3bfec352aa7b-delete_snapshot" released by "delete_snapshot" :: held 3.405s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Lock "cinder-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:42 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" acquired by "delete_volume" :: waited 0.020s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:42 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbad9e-d044-4c25-96bc-995f71b0b9ec]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:42 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:43 devstack sudo[107439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83
Jul 06 21:12:43 devstack sudo[107439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:43 devstack sudo[107439]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" returned: 0 in 0.863s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:43 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:43 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83
Jul 06 21:12:43 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:44 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" returned: 0 in 0.752s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83" released by "delete_volume" :: held 1.677s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Created reservations ['672894dd-5d2e-4df0-8e8f-d521cf3953cc', '6b22e64c-5798-40e9-8967-062154a547ed', '352f17d9-891a-4c73-94b3-2a9156f80c51', 'c7001ddd-a5bf-4e05-9493-9d79c912b266'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:44 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:44 devstack sudo[107448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:44 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:45 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.662s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:45 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-321d0ce2-eaab-4752-ab50-25c373d608a6 tempest-ProjectMemberTests-403782602 None] Lock "cinder-8e05ccd3-cc5b-4f2b-a3e3-74b710f21f83-delete_volume" released by "delete_volume" :: held 2.551s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (782e3c1c-4e80-4eb9-8a83-dd52d9f1e802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f983a331-0313-4354-9c63-47b0e294210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f983a331-0313-4354-9c63-47b0e294210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-396479755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7454ba5b-c159-40bc-9514-a18442668be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:46Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7103fc5c-8bae-4b5c-8dd0-944ade80d38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7103fc5c-8bae-4b5c-8dd0-944ade80d38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e64c77-f347-49be-b482-835b117b916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90e64c77-f347-49be-b482-835b117b916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7454ba5b-c159-40bc-9514-a18442668be7', 'volume_name': 'volume-7454ba5b-c159-40bc-9514-a18442668be7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f22744-1664-4fe8-9674-90ded1aa1cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f22744-1664-4fe8-9674-90ded1aa1cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000b62d0-e094-421e-bc9e-a5d14746e33c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:45 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Volume 7454ba5b-c159-40bc-9514-a18442668be7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7454ba5b-c159-40bc-9514-a18442668be7', 'volume_size': 1}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-396479755',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7454ba5b-c159-40bc-9514-a18442668be7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:46Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Creating volume 7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:12:45 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:12:45 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:45 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 1073741824
Jul 06 21:12:45 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:46 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 1073741824" returned: 0 in 0.843s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:46 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:46 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7
Jul 06 21:12:46 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:47 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7" returned: 0 in 0.702s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (000b62d0-e094-421e-bc9e-a5d14746e33c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7454ba5b-c159-40bc-9514-a18442668be7', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a29c0b-da00-44a6-977d-cdeaff6dde5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:47 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Volume volume-7454ba5b-c159-40bc-9514-a18442668be7 (7454ba5b-c159-40bc-9514-a18442668be7): created successfully
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a29c0b-da00-44a6-977d-cdeaff6dde5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (782e3c1c-4e80-4eb9-8a83-dd52d9f1e802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:47 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-becf33a0-73d8-474b-baa2-87c0ac449569 tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Creating offline snapshot 5ce94e91-5f09-4d82-8e36-77738e7765b7 of volume 7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf1d6cb-1bce-4261-ae02-f224a8c4a0fc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:47 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:47 devstack sudo[107460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7
Jul 06 21:12:47 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:48 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7" returned: 0 in 0.756s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:48 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:48 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 1G
Jul 06 21:12:48 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:49 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 1G" returned: 0 in 0.782s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7454ba5b-c159-40bc-9514-a18442668be7 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:49 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7454ba5b-c159-40bc-9514-a18442668be7 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7
Jul 06 21:12:49 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:50 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7454ba5b-c159-40bc-9514-a18442668be7 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7" returned: 0 in 0.683s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:50 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 is being set with open permissions: ugo+rw
Jul 06 21:12:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:50 devstack sudo[107476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7
Jul 06 21:12:50 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:50 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7" returned: 0 in 0.647s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:50 devstack sudo[107479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.info
Jul 06 21:12:50 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:51 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.info" returned: 0 in 0.643s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:51 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.info is being set with open permissions: ugo+rw
Jul 06 21:12:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:51 devstack sudo[107482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.info
Jul 06 21:12:51 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:52 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.info" returned: 0 in 0.648s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.244s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:52 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-75ea4d48-e2c3-4af0-92a0-3c463634adf7 tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-5ce94e91-5f09-4d82-8e36-77738e7765b7-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Lock "cinder-5ce94e91-5f09-4d82-8e36-77738e7765b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-7454ba5b-c159-40bc-9514-a18442668be7" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-7454ba5b-c159-40bc-9514-a18442668be7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-5ce94e91-5f09-4d82-8e36-77738e7765b7" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-5ce94e91-5f09-4d82-8e36-77738e7765b7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot 5ce94e91-5f09-4d82-8e36-77738e7765b7 of volume 7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fea82a4-9d9e-401d-95d8-563b60c5f92d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:53 devstack sudo[107485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7
Jul 06 21:12:53 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:53 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7" returned: 0 in 0.759s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7454ba5b-c159-40bc-9514-a18442668be7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf1c16e-9d4c-449e-932a-19d916da1df5]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:54 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7
Jul 06 21:12:54 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:54 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7" returned: 0 in 0.755s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:54 devstack sudo[107495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7
Jul 06 21:12:54 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:55 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7" returned: 0 in 0.723s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:55 devstack sudo[107500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7
Jul 06 21:12:55 devstack sudo[107500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:56 devstack sudo[107500]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7.5ce94e91-5f09-4d82-8e36-77738e7765b7" returned: 0 in 0.635s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-5ce94e91-5f09-4d82-8e36-77738e7765b7" released by "_delete_snapshot" :: held 2.964s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-7454ba5b-c159-40bc-9514-a18442668be7" released by "delete_snapshot" :: held 2.988s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Created reservations ['1698fd5c-1030-4991-bfea-02fc67a7167d', '8849c73c-53a9-4f7b-9a42-9262f4bce54f', '37afc82c-f99e-4b6c-8e4d-28ac49577af3', '60a78bd9-6f6b-4957-840c-71d3bd48ecca'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-a9ab4f72-6ff7-4cfd-a6ba-c0f3eed37270 tempest-ProjectMemberTests-403782602 None] Lock "cinder-5ce94e91-5f09-4d82-8e36-77738e7765b7-delete_snapshot" released by "delete_snapshot" :: held 3.126s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-7454ba5b-c159-40bc-9514-a18442668be7-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Lock "cinder-7454ba5b-c159-40bc-9514-a18442668be7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-7454ba5b-c159-40bc-9514-a18442668be7" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-7454ba5b-c159-40bc-9514-a18442668be7" acquired by "delete_volume" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bf3258-f8ce-4c0a-95d8-c9f3caa8e4cb]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:12:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:56 devstack sudo[107503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7
Jul 06 21:12:56 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:57 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7" returned: 0 in 0.749s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:57 devstack sudo[107508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7
Jul 06 21:12:57 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:57 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-7454ba5b-c159-40bc-9514-a18442668be7" returned: 0 in 0.651s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-7454ba5b-c159-40bc-9514-a18442668be7" released by "delete_volume" :: held 1.457s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Created reservations ['b76b4937-7330-4631-b422-83f677563dcf', '63b12a6d-9373-4939-8865-4b0dc0cb3b4c', '47143caf-e768-418c-93da-36b30bd4d6e0', 'ad18d998-1aa3-4f7d-ad46-f8cbb517f37f'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:57 devstack sudo[107511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:12:57 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:58 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.648s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:12:58 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-cd794b35-a5f9-4d2b-8f05-9d6677477ef2 tempest-ProjectMemberTests-403782602 None] Lock "cinder-7454ba5b-c159-40bc-9514-a18442668be7-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (06704c7a-51ad-41cf-9bd5-e91572841f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e901280d-ee16-4173-a9c0-3df4f91bd898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e901280d-ee16-4173-a9c0-3df4f91bd898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882824030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2604d0-fda8-46de-8d59-6ab793d17446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:59Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f258685-ad00-42d6-94af-3f815142c7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f258685-ad00-42d6-94af-3f815142c7d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d87845-672e-4cc0-8957-cc95de017705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d87845-672e-4cc0-8957-cc95de017705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b2604d0-fda8-46de-8d59-6ab793d17446', 'volume_name': 'volume-6b2604d0-fda8-46de-8d59-6ab793d17446', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55306c42-221f-4d0d-837e-2403b311404c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55306c42-221f-4d0d-837e-2403b311404c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1766df5-5ecc-4e50-84af-c75bb93d1022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:12:58 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Volume 6b2604d0-fda8-46de-8d59-6ab793d17446: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b2604d0-fda8-46de-8d59-6ab793d17446', 'volume_size': 1}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-882824030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b2604d0-fda8-46de-8d59-6ab793d17446,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7758219a024466b92208802bccabda2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:59Z,use_quota=True,user_id='19038aed91f141c1ae80853faa416a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Creating volume 6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:12:58 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:12:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:58 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 1073741824
Jul 06 21:12:58 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:12:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Jul 06 21:12:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 1073741824" returned: 0 in 0.800s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:12:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:12:59 devstack sudo[107521]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446
Jul 06 21:12:59 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:00 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446" returned: 0 in 0.626s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:00 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:13:00 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1766df5-5ecc-4e50-84af-c75bb93d1022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b2604d0-fda8-46de-8d59-6ab793d17446', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0187112f-19d3-4167-b392-8841fca6186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:00 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Volume volume-6b2604d0-fda8-46de-8d59-6ab793d17446 (6b2604d0-fda8-46de-8d59-6ab793d17446): created successfully
Jul 06 21:13:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0187112f-19d3-4167-b392-8841fca6186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:00 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Flow 'volume_create_manager' (06704c7a-51ad-41cf-9bd5-e91572841f9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:13:00 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-e85ebd01-3af3-44ec-ac01-4c36538acc69 tempest-ProjectMemberTests-403782602 None] Created volume successfully.
Jul 06 21:13:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:01 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Creating offline snapshot 00764895-0f49-4148-baf4-377f6e685d62 of volume 6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:13:01 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a25247b-9c59-42f1-a08a-b19f4e29850d]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:13:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:01 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446
Jul 06 21:13:01 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:01 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446" returned: 0 in 0.747s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:01 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:01 devstack sudo[107529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 1G
Jul 06 21:13:01 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:02 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 1G" returned: 0 in 0.777s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:02 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2604d0-fda8-46de-8d59-6ab793d17446 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:02 devstack sudo[107534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2604d0-fda8-46de-8d59-6ab793d17446 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62
Jul 06 21:13:02 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:03 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6b2604d0-fda8-46de-8d59-6ab793d17446 -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62" returned: 0 in 0.751s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:03 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 is being set with open permissions: ugo+rw
Jul 06 21:13:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:03 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62
Jul 06 21:13:03 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:04 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62" returned: 0 in 0.669s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:04 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.info
Jul 06 21:13:04 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:04 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.info" returned: 0 in 0.648s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:04 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.info is being set with open permissions: ugo+rw
Jul 06 21:13:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:04 devstack sudo[107545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.info
Jul 06 21:13:04 devstack sudo[107545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:05 devstack sudo[107545]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.info" returned: 0 in 0.669s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-eb44cbdf-32ee-4eef-b0d7-77a6a74e713d tempest-ProjectMemberTests-403782602 None] Create snapshot completed successfully
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-00764895-0f49-4148-baf4-377f6e685d62-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Lock "cinder-00764895-0f49-4148-baf4-377f6e685d62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-6b2604d0-fda8-46de-8d59-6ab793d17446" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-6b2604d0-fda8-46de-8d59-6ab793d17446" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-00764895-0f49-4148-baf4-377f6e685d62" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-00764895-0f49-4148-baf4-377f6e685d62" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Deleting offline snapshot 00764895-0f49-4148-baf4-377f6e685d62 of volume 6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] snapshot_file for this snap is: volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ebd23c-e8fe-40ec-81ca-cb2e3edf3259]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:13:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:06 devstack sudo[107548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62
Jul 06 21:13:06 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:07 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62" returned: 0 in 0.742s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6b2604d0-fda8-46de-8d59-6ab793d17446(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:13:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce8f8a5-f219-4a33-ab3e-c46b9a813a61]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:13:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:07 devstack sudo[107553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446
Jul 06 21:13:07 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:08 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446" returned: 0 in 0.752s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:08 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62
Jul 06 21:13:08 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:08 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62" returned: 0 in 0.758s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:08 devstack sudo[107564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62
Jul 06 21:13:08 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:09 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446.00764895-0f49-4148-baf4-377f6e685d62" returned: 0 in 0.628s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-00764895-0f49-4148-baf4-377f6e685d62" released by "_delete_snapshot" :: held 2.968s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-6b2604d0-fda8-46de-8d59-6ab793d17446" released by "delete_snapshot" :: held 2.993s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Created reservations ['555d51c2-e33a-4cd9-8fbb-a82eed4d452f', '2e964165-e783-495f-99d9-9dff5bbe42a8', 'dfc3744f-2b7c-424a-8638-1a17df95ba37', 'b9b6a124-21be-4bcb-8677-2d06ed455442'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:13:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Delete snapshot completed successfully.
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-6c98b648-b424-42ce-a25c-4ed8eed57957 tempest-ProjectMemberTests-403782602 None] Lock "cinder-00764895-0f49-4148-baf4-377f6e685d62-delete_snapshot" released by "delete_snapshot" :: held 3.137s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-6b2604d0-fda8-46de-8d59-6ab793d17446-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Lock "cinder-6b2604d0-fda8-46de-8d59-6ab793d17446-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Acquiring lock "cinder-quobyte-6b2604d0-fda8-46de-8d59-6ab793d17446" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-6b2604d0-fda8-46de-8d59-6ab793d17446" acquired by "delete_volume" :: waited 0.012s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0775b38-4a1f-4948-95c0-5c7853be4ec4]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:13:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:09 devstack sudo[107567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446
Jul 06 21:13:09 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:10 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446" returned: 0 in 0.751s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:10 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446
Jul 06 21:13:10 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:11 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-6b2604d0-fda8-46de-8d59-6ab793d17446" returned: 0 in 0.640s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Lock "cinder-quobyte-6b2604d0-fda8-46de-8d59-6ab793d17446" released by "delete_volume" :: held 1.448s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Created reservations ['5063f4ad-35fa-4734-81c2-abc4bedf2253', '88d2ec5f-efae-463d-821c-2680b7dc4853', '6454587e-62ec-473c-b48d-ca5410f19a73', '399ab32b-f683-4a8a-b96e-78a2b588b92e'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:11 devstack sudo[107575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:13:11 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:11 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.670s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:13:11 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Deleted volume successfully.
Jul 06 21:13:11 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-b93f0575-df82-4f0c-a129-9760f85ee28a tempest-ProjectMemberTests-403782602 None] Lock "cinder-6b2604d0-fda8-46de-8d59-6ab793d17446-delete_volume" released by "delete_volume" :: held 2.315s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:13:21 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=57,cinder:SELECT=40,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:13:21 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=44,cinder:INSERT=20,cinder:UPDATE=59,cinder:DELETE=6 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:13:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:13:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:13:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:13:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:37 devstack sudo[107623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:13:37 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:38 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.751s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:13:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:13:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:13:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Flow 'volume_create_manager' (91b2f525-8af7-462e-8a5e-13f66b16fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a017ee-6b52-461b-9143-2c01d1ad947b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a017ee-6b52-461b-9143-2c01d1ad947b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1333738028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0491a8-d2bc-4ba9-bc6c-081e5714e40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018f2f767d6546dcbb1c3c7c4d28a535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:49Z,use_quota=True,user_id='1aaa7b9ccbfe4f859bd2b37538079287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe07f58-e0e7-4d6a-9f59-882dc316c78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fe07f58-e0e7-4d6a-9f59-882dc316c78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff5b218-220b-42d7-bd4c-c7093df9e441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bff5b218-220b-42d7-bd4c-c7093df9e441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c0491a8-d2bc-4ba9-bc6c-081e5714e40d', 'volume_name': 'volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df3be22-2575-4e24-91a0-78ee6502a3bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df3be22-2575-4e24-91a0-78ee6502a3bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bd5761-5218-4917-8d81-3c7c1c550381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:49 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Volume 4c0491a8-d2bc-4ba9-bc6c-081e5714e40d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d', 'volume_size': 1}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x713decc7d100>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1333738028',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c0491a8-d2bc-4ba9-bc6c-081e5714e40d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018f2f767d6546dcbb1c3c7c4d28a535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:49Z,use_quota=True,user_id='1aaa7b9ccbfe4f859bd2b37538079287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)}" {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Creating volume 4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:13:49 devstack cinder-volume[86721]: INFO cinder.volume.drivers.remotefs [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] casted to osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2
Jul 06 21:13:49 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d 1073741824 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:49 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d 1073741824
Jul 06 21:13:49 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:50 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d 1073741824" returned: 0 in 0.823s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:50 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:50 devstack sudo[107638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d
Jul 06 21:13:50 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:51 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" returned: 0 in 0.628s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] <== create_volume: return (1492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'} {{(pid=86721) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.495s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bd5761-5218-4917-8d81-3c7c1c550381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d', 'volume_size': 1}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e0f3e-3ad4-4d2a-ad0e-2683856a59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:51 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Volume volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d (4c0491a8-d2bc-4ba9-bc6c-081e5714e40d): created successfully
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8e0f3e-3ad4-4d2a-ad0e-2683856a59de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Flow 'volume_create_manager' (91b2f525-8af7-462e-8a5e-13f66b16fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:13:51 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-83cb48c1-c05c-4bed-b54f-f38e9d73e021 tempest-SnapshotDependencyTests-749809342 None] Created volume successfully.
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Creating offline snapshot 22c5a5a0-f088-4fd0-a8d8-754275f59924 of volume 4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfd8f07-e8f7-48ed-ad3c-6befaa041a30]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:13:51 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:51 devstack sudo[107641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d
Jul 06 21:13:51 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:52 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" returned: 0 in 0.768s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:52 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 1G {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:52 devstack sudo[107646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 1G
Jul 06 21:13:52 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:53 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 1G" returned: 0 in 0.851s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:53 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:53 devstack sudo[107653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924
Jul 06 21:13:53 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:54 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d -F qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924" returned: 0 in 0.685s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:54 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 is being set with open permissions: ugo+rw
Jul 06 21:13:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:54 devstack sudo[107658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924
Jul 06 21:13:54 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:54 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924" returned: 0 in 0.646s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:54 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:54 devstack sudo[107661]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.info
Jul 06 21:13:54 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:55 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.info" returned: 0 in 0.637s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:55 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.info is being set with open permissions: ugo+rw
Jul 06 21:13:55 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.info {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:55 devstack sudo[107664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.info
Jul 06 21:13:55 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:56 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.info" returned: 0 in 0.653s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:56 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.328s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:56 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-383304d9-5063-4d5c-9949-4faa5c378e52 tempest-SnapshotDependencyTests-749809342 None] Create snapshot completed successfully
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86721) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Flow 'volume_create_manager' (2f28208b-65f3-4040-a1cb-1e308cdbeb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10156501-9060-4341-9d46-f6fd1e9d9b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10156501-9060-4341-9d46-f6fd1e9d9b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-07-06T19:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb8d859b-c027-4ca5-8277-312f65ff34a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='018f2f767d6546dcbb1c3c7c4d28a535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=22c5a5a0-f088-4fd0-a8d8-754275f59924,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:57Z,use_quota=True,user_id='1aaa7b9ccbfe4f859bd2b37538079287',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9ada3726-0e71-4194-94bd-915512aadc5e),volume_type_id=9ada3726-0e71-4194-94bd-915512aadc5e)' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9f892b-b7c5-462a-95be-079e6ff42864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad9f892b-b7c5-462a-95be-079e6ff42864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff657b92-6024-4ad7-bb1d-9cf153c60204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff657b92-6024-4ad7-bb1d-9cf153c60204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fb8d859b-c027-4ca5-8277-312f65ff34a8', 'volume_name': 'volume-fb8d859b-c027-4ca5-8277-312f65ff34a8', 'volume_size': 1, 'snapshot_id': '22c5a5a0-f088-4fd0-a8d8-754275f59924'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0595bafb-d913-45ba-b159-f0a30bfcfeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0595bafb-d913-45ba-b159-f0a30bfcfeed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ad7384-665e-4888-9374-6e91797ad610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:13:57 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Volume fb8d859b-c027-4ca5-8277-312f65ff34a8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fb8d859b-c027-4ca5-8277-312f65ff34a8', 'volume_size': 1, 'snapshot_id': '22c5a5a0-f088-4fd0-a8d8-754275f59924'}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-quobyte-22c5a5a0-f088-4fd0-a8d8-754275f59924-fb8d859b-c027-4ca5-8277-312f65ff34a8" by "_create_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-22c5a5a0-f088-4fd0-a8d8-754275f59924-fb8d859b-c027-4ca5-8277-312f65ff34a8" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Creating volume fb8d859b-c027-4ca5-8277-312f65ff34a8 from snapshot 22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Selected osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2 as target Quobyte volume. {{(pid=86721) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-quobyte-fb8d859b-c027-4ca5-8277-312f65ff34a8" by "_copy_volume_from_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-fb8d859b-c027-4ca5-8277-312f65ff34a8" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] snapshot: 22c5a5a0-f088-4fd0-a8d8-754275f59924, volume: fb8d859b-c027-4ca5-8277-312f65ff34a8,  {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c77d06-a254-4990-a979-ddf6a167f570]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:13:57 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:57 devstack sudo[107667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924
Jul 06 21:13:57 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:58 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924" returned: 0 in 0.779s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:13:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] will copy from snapshot at /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Jul 06 21:13:58 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Creating direct copy from snapshot {{(pid=86721) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Jul 06 21:13:58 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87dc2b3-fb63-4084-a33d-981394748081]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:13:58 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:58 devstack sudo[107673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d
Jul 06 21:13:58 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:13:59 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root
Jul 06 21:13:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" returned: 0 in 0.763s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:13:59 devstack cinder-volume[86721]: DEBUG cinder.utils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Path /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 not found in is_blk_device check {{(pid=86721) is_blk_device /opt/stack/cinder/cinder/utils.py:615}}
Jul 06 21:13:59 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:13:59 devstack sudo[107678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8
Jul 06 21:13:59 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:03 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8" returned: 0 in 4.505s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:03 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c69869-aa87-4ae4-8d68-1a7723ddc386]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:14:03 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:03 devstack sudo[107691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d
Jul 06 21:14:03 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:04 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" returned: 0 in 0.937s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:04 devstack cinder-volume[86721]: DEBUG cinder.image.image_utils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Image conversion details: src /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 {{(pid=86721) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}}
Jul 06 21:14:04 devstack cinder-volume[86721]: INFO cinder.image.image_utils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Converted 1024.00 MB image at 227.23 MB/s
Jul 06 21:14:04 devstack cinder-volume[86721]: WARNING cinder.volume.drivers.remotefs [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 is being set with open permissions: ugo+rw
Jul 06 21:14:04 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:04 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8
Jul 06 21:14:04 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:05 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8" returned: 0 in 0.651s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-fb8d859b-c027-4ca5-8277-312f65ff34a8" released by "_copy_volume_from_snapshot" :: held 7.725s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-22c5a5a0-f088-4fd0-a8d8-754275f59924-fb8d859b-c027-4ca5-8277-312f65ff34a8" released by "_create_volume_from_snapshot" :: held 7.754s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.769s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ad7384-665e-4888-9374-6e91797ad610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb8d859b-c027-4ca5-8277-312f65ff34a8', 'volume_size': 1, 'snapshot_id': '22c5a5a0-f088-4fd0-a8d8-754275f59924'}' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e871a4-e425-4a2b-b9fa-27a906d3f612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Jul 06 21:14:05 devstack cinder-volume[86721]: INFO cinder.volume.flows.manager.create_volume [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Volume volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 (fb8d859b-c027-4ca5-8277-312f65ff34a8): created successfully
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e871a4-e425-4a2b-b9fa-27a906d3f612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86721) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Jul 06 21:14:05 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Flow 'volume_create_manager' (2f28208b-65f3-4040-a1cb-1e308cdbeb7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86721) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Jul 06 21:14:05 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-8b96d6fd-f3c9-4866-a477-56c73986073d tempest-SnapshotDependencyTests-749809342 None] Created volume successfully.
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-22c5a5a0-f088-4fd0-a8d8-754275f59924-delete_snapshot" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-22c5a5a0-f088-4fd0-a8d8-754275f59924-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-quobyte-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" by "delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-quobyte-22c5a5a0-f088-4fd0-a8d8-754275f59924" by "_delete_snapshot" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-22c5a5a0-f088-4fd0-a8d8-754275f59924" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Deleting offline snapshot 22c5a5a0-f088-4fd0-a8d8-754275f59924 of volume 4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] snapshot_file for this snap is: volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e7e598-557f-499a-bb80-852d655619fc]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:14:06 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:06 devstack sudo[107699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924
Jul 06 21:14:06 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:07 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924" returned: 0 in 0.770s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:07 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.remotefs [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86721) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Jul 06 21:14:07 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e54b405-93ff-48e7-adc5-a2dbb86cfdbd]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:14:07 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:07 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d
Jul 06 21:14:07 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:08 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" returned: 0 in 0.750s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:08 devstack sudo[107709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924
Jul 06 21:14:08 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:08 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924" returned: 0 in 0.729s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:08 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:08 devstack sudo[107715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924
Jul 06 21:14:08 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:09 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:09 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d.22c5a5a0-f088-4fd0-a8d8-754275f59924" returned: 0 in 0.650s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-22c5a5a0-f088-4fd0-a8d8-754275f59924" released by "_delete_snapshot" :: held 3.006s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" released by "delete_snapshot" :: held 3.033s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:09 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Created reservations ['4510dda9-4cb4-4ff3-bf32-b045b96e4c6f', '82a89462-f2d0-4403-b400-8174964d12ab', '5dd71d72-e198-4f61-9068-6376b79bdf10', '0d3d3f25-9c67-4087-9a3e-f45ac03c49cd'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:14:09 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Delete snapshot completed successfully.
Jul 06 21:14:09 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5db7dca9-ec62-48ae-9050-d84831c0e196 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-22c5a5a0-f088-4fd0-a8d8-754275f59924-delete_snapshot" released by "delete_snapshot" :: held 3.168s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:14:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:14:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-quobyte-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:14:10 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" acquired by "delete_volume" :: waited 0.016s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:14:10 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f348cb-bc1e-4e54-94c9-58567ec27dff]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:14:10 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:10 devstack sudo[107718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d
Jul 06 21:14:10 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:11 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" returned: 0 in 0.785s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:11 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:11 devstack sudo[107723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d
Jul 06 21:14:11 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:12 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" returned: 0 in 0.627s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d" released by "delete_volume" :: held 1.475s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Created reservations ['9d2b8299-853b-4314-9655-bed141a627ef', 'faffb663-60b0-465e-9ba5-80fbad013cb1', '10980a0c-c863-4ecc-a3d6-6d8e13d7626a', 'f9ce7fe8-3782-4424-be48-a172ac4148a4'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:14:12 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:12 devstack sudo[107726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:14:12 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-fb8d859b-c027-4ca5-8277-312f65ff34a8-delete_volume" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-fb8d859b-c027-4ca5-8277-312f65ff34a8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "cinder-quobyte-fb8d859b-c027-4ca5-8277-312f65ff34a8" by "delete_volume" {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-fb8d859b-c027-4ca5-8277-312f65ff34a8" acquired by "delete_volume" :: waited 0.017s {{(pid=86721) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Jul 06 21:14:13 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b9a2f4-9b29-415b-b960-fa3e36834967]: (4, 'qcow2') {{(pid=88305) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.703s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:14:13 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Deleted volume successfully.
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-d03fea12-ceb8-4e3c-acec-d6fbabadd125 tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-4c0491a8-d2bc-4ba9-bc6c-081e5714e40d-delete_volume" released by "delete_volume" :: held 2.383s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:13 devstack sudo[107729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8
Jul 06 21:14:13 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:13 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8" returned: 0 in 0.764s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:13 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:13 devstack sudo[107734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8
Jul 06 21:14:13 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:14 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799/volume-fb8d859b-c027-4ca5-8277-312f65ff34a8" returned: 0 in 0.651s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-quobyte-fb8d859b-c027-4ca5-8277-312f65ff34a8" released by "delete_volume" :: held 1.458s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG cinder.quota [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Created reservations ['44ce2e53-95ff-4b70-bd52-5aabe2e05cec', '24b37513-9e65-45da-9bc6-c10fe7cdca59', '78f9cef2-39d8-455b-ae33-41a0b4a65ff5', '674f85d9-3446-4895-8bca-2b606b04d5a4'] {{(pid=86721) reserve /opt/stack/cinder/cinder/quota.py:752}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:14:14 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:14 devstack sudo[107737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:14:14 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:15 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:15 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.664s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:15 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:14:15 devstack cinder-volume[86721]: INFO cinder.volume.manager [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Deleted volume successfully.
Jul 06 21:14:15 devstack cinder-volume[86721]: DEBUG cinder.coordination [None req-5778c80a-9cc9-4692-acc6-105f89fc1fde tempest-SnapshotDependencyTests-749809342 None] Lock "cinder-fb8d859b-c027-4ca5-8277-312f65ff34a8-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86721) __release /opt/stack/cinder/cinder/coordination.py:152}}
Jul 06 21:14:24 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:UPDATE=24,cinder:SELECT=25,cinder:DELETE=2,cinder:INSERT=8 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:14:25 devstack cinder-volume[86721]: DEBUG dbcounter [-] [86721] Writing DB stats cinder:SELECT=22,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86721) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Jul 06 21:14:37 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:14:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
Jul 06 21:14:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
Jul 06 21:14:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2': None} {{(pid=86721) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Jul 06 21:14:37 devstack cinder-volume[86721]: DEBUG cinder.volume.drivers.quobyte [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1dcb4dc6-d851-4741-85dd-ed600af586c2'] {{(pid=86721) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Jul 06 21:14:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.lockutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86721) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
Jul 06 21:14:37 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799 {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Jul 06 21:14:37 devstack sudo[108032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799
Jul 06 21:14:37 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jul 06 21:14:38 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root
Jul 06 21:14:38 devstack cinder-volume[86721]: DEBUG oslo_concurrency.processutils [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/68ce754c7798444c1ee06d78e27fe799" returned: 0 in 0.659s {{(pid=86721) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Jul 06 21:14:38 devstack cinder-volume[86721]: DEBUG cinder.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Notifying Schedulers of capabilities ... {{(pid=86721) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Jul 06 21:14:38 devstack cinder-volume[86721]: DEBUG oslo_service.periodic_task [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] Running periodic task VolumeManager._thread_info {{(pid=86721) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
Jul 06 21:14:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread count: 28 {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Jul 06 21:14:38 devstack cinder-volume[86721]: DEBUG cinder.volume.manager [None req-54967006-bfef-441b-9b17-f43fa0ceaaa7 None None] thread info: [<_MainThread(MainThread, started 124510891077760)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 124510781302720)>, <Thread(Thread-3 (stat_writer), started daemon 124510782103488)>, <Thread(Rabbit-heartbeat, started daemon 124510778971456)>, <Thread(Thread-5 (_runner), started daemon 124510777176192)>, <Thread(Thread-7 (_runner), started daemon 124510777225984)>, <Thread(fd_logger, started daemon 124510776974464)>, <Thread(privsep_reader, started daemon 124510775137792)>, <Thread(tpool_thread_0, started daemon 124510765622976)>, <Thread(tpool_thread_1, started daemon 124510757230272)>, <Thread(tpool_thread_2, started daemon 124510748837568)>, <Thread(tpool_thread_3, started daemon 124510740444864)>, <Thread(tpool_thread_4, started daemon 124510732052160)>, <Thread(tpool_thread_5, started daemon 124510723659456)>, <Thread(tpool_thread_6, started daemon 124510715266752)>, <Thread(tpool_thread_7, started daemon 124510706874048)>, <Thread(tpool_thread_8, started daemon 124510698481344)>, <Thread(tpool_thread_9, started daemon 124510690088640)>, <Thread(tpool_thread_10, started daemon 124510681679552)>, <Thread(tpool_thread_11, started daemon 124510673270464)>, <Thread(tpool_thread_12, started daemon 124510664861376)>, <Thread(tpool_thread_13, started daemon 124510656452288)>, <Thread(tpool_thread_14, started daemon 124510648043200)>, <Thread(tpool_thread_15, started daemon 124510639634112)>, <Thread(tpool_thread_16, started daemon 124510631225024)>, <Thread(tpool_thread_17, started daemon 124510622815936)>, <Thread(tpool_thread_18, started daemon 124510614406848)>, <Thread(tpool_thread_19, started daemon 124510605997760)>] {{(pid=86721) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}